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1.   Introduction 

In  the  following  chapters  we  prove  various  results  for  control  of 
systems  governed  by  functional  differential  equations  of  neutral  type.   These 
equations  are  generalizations  of  the  equation 

x(t)  +  Ax(t-h)  =  Bx(t)  +  Cx(t-h)  +  Du(t), 

which  has  been  studied  extensively  (for  example,  see  Bellman  and  Cooke  [^]). 

Chapter  2  contains  results  in  the  theory  of  neutral  equations.   The 
form  of  the  left-hand  side  of  equation  (2.1)  given  by  (2.3)  was  first  used  in 
Hale  and  Meyer  [  1^-] .   The  type  of  hereditary  dependence  employed  here  occurs 
especially  in  integral  equations;  although  this  dependence  puts  a  different 
topology  on  the  domain  of  the  functions  than  that  used  in  the  original  proofs 
of  the  main  theorems,  the  change  does  not  alter  the  proofs  significantly. 
Needless  to  say,  the  work  of  Professor  Hale  and  his  associates  has  greatly 
influenced  many  of  the  ideas  and  proofs  in  this  thesis. 

In  chapter  3  we  develop  the  concepts  which  will  be  used  to  prove 
necessary  conditions.   The  definitions  of  C(I, X)™  v     and  of  a  quasi-convex 
family  are  extensions  of  the  definitions  of  AC(I,X)    and  of  an  absolutely 
quasi-convex  family  given  in  Banks  [1],   The  general  approach  of  the  proof 
of  theorem  3.1  follows  a  proof  given  by  Neustadt  [21;  theorem  3.1]  in  the 
case  of  ordinary  differential  equations;  Neustadt  gives  credit  to  Gamkrelidze 
[10;  theorem  2.1]  for  many  of  the  ideas  of  the  proof. 

Chapter  k   contains  three  control  problems  and  the  corresponding 
necessary  conditions.   In  addition,  results  for  the  third  problem  from  a 
slightly  different  approach  are  stated  without  proof.   The  proofs  use  the 
properties  of  quasi-convex  families  in  a  manner  similar  to  that  of  the  proofs  of 
Neustadt  in  [21]  and  [22]^  rather  than  the  techniques  of  the  Hamiltonian  func- 


tion  and  variations  as  used  by  Pontryagin  et  al.  in  [23],   Kamenskii  and 
Khvilon  [19]  use  the  latter  method  to  obtain  necessary  conditions  for  the  equa- 
tion 

x(t)  =  f(x(t),  x(fa(t))f  x(h(t)),  u(t)). 

Although  they  allow  nonlinearities  in  x(h(t)),  the  rest  of  their  assumptions 
are  much  more  restrictive  than  those  made  below.   Theorem  4.3  describes  nec- 
essary conditions  for  driving  a  solution  of  the  system  equations  to  a  terminal 
function  rather  than  a  terminal  point;  the  author  has  not  found  any  other  such 
conditions  in  the  literature.   Although  theorem  4.3  does  not  give  conditions 
under  which  the  multiplier  \j/  is  non-zero  on  a  set  of  positive  measure,  chapter 
6  contains  several  examples  with  non-trivial  \|/. 

The  sufficiency  conditions  of  chapter  5  are  proved  by  a  method  first 
used  by  Rozonoer  [24]  for  ordinary  differential  equations  and  cost  functions 
which  are  linear  in  x.   He  pointed  out  [24;  pp.  1*1-12,  1420]  the  necessity  of 
assuming  a    /  0  in  the  case  of  a  restrained  terminal  point.   Halanay  [11] 
extended  Rozonoer'  s  result  to  retarded  equations  in  the  case  of  a  free  end- 
point.   Lee  [20]  obtained  a  more  general  sufficiency  theorem  for  ordinary  dif- 
ferential equations.   In  parts  (B)  and  (C)  of  that  theorem  he  states  ex- 
plicitly that  a  =  -I5  although  he  does  not  state  a  /  0  in  part  (A),  his 
proof  uses  a  lemma  which  requires  a  <  0.   All  of  the  above  results  except 
part  (C)  of  Lee's  theorem  are  included  in  theorem  5.1.   Theorems  5.3  and  5.4 
on  the  existence  of  optimal  controls  are  generalizations,  from  ordinary  dif- 
ferential equations  to  neutral  equations,  of  theorems  4.1  and  4.2  of  Jacobs 
[l8].   These  are  included  to  show  a  class  of  problems  for  which  an  optimal 
control  exists;  no  attempt  has  been  made  to  prove  the  most  general  existence 
theorem. 


The  first  part  of  chapter  6  shows  the  relation  between  certain  types 
of  hyperbolic  partial  differential  equations  with  boundary  controls  and  neutral 
equations  with  control.   Other  authors  have  shown  that  some  hyperbolic  partial 
differential  equations  can  be  transformed  into  neutral  equations  (see  [5]  and 
[7]).   Theorem  6.1  is  a  specialization  of  theorem  4.3  to  equations  with  one 
fixed  lag  and  constant  coefficients,  a  fixed  initial  function,  and  a  fixed  final 
time.   It  can  be  understood  independently  of  most  of  the  rest  of  the  thesis, 
requiring  only  some  knowledge  of  such  equations,  lemma  3.3  (conditions  for  a 
family  of  functions  to  be  quasiconvex),  and  remark  4.6  (on  non-triviality  of 
the  multipliers).   The  last  part  of  the  chapter  contains  examples  for  which 
problem  4.3  is  normal  and  theorems  4.3  (or  6.1)  and  5.2' prove  certain  controls 
are  optimal. 


2.  Neutral  Equations 

We  will  work  on  an  interval  [a  } a.),    where  -°o  <  a  <  t  <  a  <  °o. 

A  function  h(x(*),t)   may  depend  on  any  or  all  values  x(s)^  a  <  s  <  t. 

On  C([a  ,t]_,R  )   we  use  the  norm  ||^|L  =    sup    |^(s)|   (the  subscript  t 

t   aQ  <  s  <  t 

may  be  oramitted).   Throughout  the  discussion  the  following  convention  holds: 

If  \]/  e  C([a  ,t],R  )j    t  <  t  <  t  <  a.,   we  also  consider  \|/  e  C([a  ,t],R  )  by 

setting  ^(s)  =  4'(T)   for   s  e  [t,t].   x   denotes  the  restriction  of  x  to 

foL.a].   We  note  that  this  convention  means  for  t^  <  a  <  t  <  a,  x  and  x 
L  0'  0  —         '         a 

are  both  elements  of  C([a  ,t]_,R  ),    but  unless  x  is  constant  on  [cr,t]   they 
are  different  functions. 

We  consider  the  equation 


(2.1)        .  ft-[D(x(.),t)]  =  f(x(.),t) 


together  with  the  initial  condition 


(2.2)  x(t)  =  cp(t)   on  [a0,tQ]. 


We  shall  consider  y  to  be  a  (local)  solution  of  (2.1)^  (2.2)  if  there  is  a 
x ,   t  <  x  <  a.,    such  that  y  satisfies  (2.2)  and  satisfies  (2.1)  a.e.  on 
[t  , t].   Unless  otherwise  stated  we  also  require  a  solution  y  to  be  in 
C([a0,T],Rn). 

The  following  standing  assumptions  are  made: 


t 
(2.3)  D(x(-),t)  =  x(t)  -  g(x(-),t)  =  x(t)  -  /  d  [n(t,e)]x(0) 

ao 


for  t  e  [tn,a),  where 

2    n2 
(2.4)   |i(er,0)  =  0  for  0  >  a,    p.!  R  — >  R  ^  p.  Borel-measurable;  p.  continuous 

from  the  right  in  its  first  argument  and  continuous  from  the  left  in 

its  second  argument;  u  of  "bounded  variation  on  every  finite  interval 

in  its  second  argument,  and  such  that  g(\|/,s)   is  continuous  in 

s  e  [t  ,a)   for  each  \|/  e  C([a  ,a),R  ),  (hence,  continuous  in  (^,s) 

jointly)  . 


(2.5)  there  exists  a  continuous  non-decreasing  function  6  such  that,  for 
each  t  e  [t„,a),  for  each  6  €  [0,t-a  ],   Var  n(t,»)  <  5(8),  and 

0  °   [t-e,t] 

5(0)  =  0. 

(2.6)  f(\|/,t)   is  measurable  in  t  for  each  fixed  \|/  e  C([aQ,a),R  ),  is  con- 
tinuous in  \|i  for  each  fixed  t,  and  for  each  compact  X  C  R  ,  there 
exists  k(')  s  L^  ([t  ,a),R)   such  that  |  f(i|/,s)|  <  k(s)   for  all 


locVL    0' 
s  e  [tQ,a),   \|/   e  C([aQ,a),X). 

Remark  2.1.      One  condition  which  is   sufficient  to  guarantee  that      g(^,s)      is 
continuous   in     s     over     [t    ,a)      for   fixed      \|/   e   C([aQ,a),R   )      is  that     u(s,0)    = 

j(s,0)    +  v(s,0),   where 

2 
a)     J(s,9)    =  ^=1a/s)X[h^(s)](e);    a^:   R  ->  Rn       and     ty.   R  -* R     are 

continuous,   aQ  <  h^(s)   <  s,    s   e   [tQ,a),    £   =   1, ...,p;    and 

n2 
X:    R  ->BV(R,R     )      is   given  by 


-E,    t  <  h 


X[h](t)  = 

'  0,    t  >  h 


(E  is  the  n  X  n  identity  matrix). 

2 
b)   for  each  s  e  [t  ,a),  v(s,»)  £  C([QL.a),R  ),  and  the  map  s  -» 

v(s,#):  R  ->  BV(  [  QL,  a) ,  R  )   is  continuous  (note  that  this  last 
condition,  combined  with  v(s,s)  =  0,  implies  v(*,0)   continu- 
ous). 

Proof;   Let  £  >  0,  i   e   C([a  ,a),R  )   be  fixedo   Let   s   £  [t  ,a),  consider 
s  e  [tQ,a). 

From  a),  there  exists  p  >  0  such  that  |  s-s  |  <  p   implies 

ia/so)_ai(s)|  <T(^wwi'  l=  1;ooo,P8 

From  continuity  of  the  h    and  \|/  (hence  equicontinuity  on 
[t  ,s  +p  ]),  there  exists  p~,  0  <  p?  <  p,,  such  that  ]  s-s  |  <  pp  implies 

|*(hi(a0)>-1|r(hj|(B))|  <rT2pTI) max   |a,(sjl]  '  l   =  1"" 'P< 

,6  — -L,  o  o  o  j  p 

From  b),  there  exists  p  ,   0  <  p,  <  p?,  such  that  |  s-s  |  <  p, 
implies 


["/''V'-^'-'KiM 


Thus,    for      |  s-sQ|    <  p     <  p2  <  p^ 


a  a 

g(*,s   )-g(i|/,s)|    =   |/  d   [ji(s   ,0)]i|/(0)    -  /  d0[.u(s,e)]ij,(e); 

ao  ao 


a 
■   1/  <yv(so,0)-v(s, 0)14(9) 


+  ELa/so^Vs0)>  -  ^=ia/s)^Vs))i 


<  II  \|/||    var 
[aQ,a) 


[v(s0,*)-v(s,-)]   +  ^=il'a/so)ll^h/sO))^(h/s))' 


+  ^=ila/so)"a/s)H^Vs))l 


[(2p+i)lKllI    +zi=i|aJe(so)l[l25Tl5     5S£     RT^T] 


r  o- 


♦-£ 


*=1  [(2p+l)lUl|T 


<  e. 


Theorem  2.1.   Given  (2.3)-(2.6),  open  fi  C  C([a  ,a),Rn),  cp  €  C([a  ,t  ],Rn)  fl  fl; 
there  exists  a  solution  of  (2.1),  (2.2)  over  [an,t_+y]   for  some   y  6  (0,a-t  ) 

Proofs   The  proof  is  the  same  as  that  of  Hale  and  Cruz  [13]  theorem  4.1,  in 
light  of  the  remarks  made  in  section  7  of  that  reference  and  the  arguments 
given  in  Hale  [12],  pp,  15,  l6. 

* 

Theorem  2,2,      Given  (2.3)-(2,6),   fl   open  in     [OL,a)    X  C([a  ,a)  ,Rn) ,    x     a  non- 

continuable   solution  of  (2,1),    (2,2)    on     [an,b),    t     <  b  <  a,    (t   /p)    e  fl.      Then, 

if     W  =  closure{(t,x,  ) I   t   e  [t    ,b)}      is   compact,   there   exists   a  sequence 

t     ->  b~     as     k  -»  oo     such  that      (t    ,x     )   -» dfl     as     k  -)«, 
*  k     tk 

Proofs      The  proof  is  the   same   as  that   of  Hale   and  Cruz  [13],    theorem  5°j-<> 

Theorem  2.3»      Given  (2.3)-(2„7),   fl     open  in     [an,a)   X  C([a  ,a),R   ),    x     a  non- 
continuable   solution  of  (2,1),    (2,2)    on     [ou^b),    t     <  b  <  a,    (t    ,cp)    €  fl.      Then, 
for  any  compact   set     U  c  flj    there  exists     t      e  (t„,b)      such  that     (t,x.  )    f.  U 


for  t  <  t  <  b. 
u  — 

Proof:   One  proof  of  this  has  been  given  by  Hale,  see  [  12],  theorem  5.2. 
We  now  turn  to  linear  equations,  where 


t 
(2.7)  f(x('),t)  =  /  d  [T)(t,0)]x(0),   t  e   [t  ,a) 

ao 


under  the  conditions 


2 
(2.8)      Tj(a, 0)    =  0     for     0  >  a,    tj:    R     — >  R  is  measurable,    of  bounded  variation 

on  every  finite   interval  in  its   second   argument,    T](a,  •)      left-continuous 

except   at     a,    and  there   exists     m  e  L,      (Tt    ,a),R)      such  that 
*  '  locVL   0'      ' 


var     T](a,  • )   <  m(a) . 
[a0,cr] 

Lemma  2. 1.   Given  (2.4),  (2.5),  (2.8),  the  equations 


t+  t 

(2.9)        Y(s,t)  =  E  +  /  da[Y(a,t)]u(a,s)  -  /  y(a, t) T)(a, s)da,  s  <  t 

s  s 


(2.10)  Y(t,t)  =  E 


(2.11)  Y(s,t)  =0,   s  >  t 

2  n2 

uniquely  define  a  function     Y!    R     -> R  such  that     Y(s,t)      is   left-continuous 

in     s.      In  addition,    for   every     M  >  0,    there   exists  a     B        (depending  on     M) 

such  that   fox      1 1|    <  M,    |t   |    <  M,        var  Y(-,t)    <B        and      |y(t   ,t)|    <B   . 

L^Q^00) 

Proof;   The  proof  of  the  existence  of  Y(s,t)   is  the  same  as  that  of  Henry  [151 
lemma  1.   The  proof  of  the  bound,  due  to  Banks,  is  contained  in  Banks  and 
Kent  [13]. 


Theorem  2.h,      Let  x  =  x(cp,h)   "be  the  solution  of 

t  t 

x(t)  =  D(cp,tQ)  +  g(x(.),t)  +  /  f(x(-),a)da  +  /  h(a)da,  t  >  tQ 

(2.12)  t0  t0 

x.   =  ? 

where     D,f,g     satisfy  (2.3) -(2.5),    (2.7),    (2.8),    h   e   L:[oc([t0,co),Rn) .      Then, 
for     t  >  t 

*o    t+ 
x(t)  =  Y(t0,t)D(cp,t  )  +  /  ud  {-/  d  [y(a,t)]n(a,p) 

a   p  t 

(2-«)  t  °t. 

+  /  Y(a,t)n(a,p)da}cp(p)  +  /  y(a,t)h(a)da 
*0  *0 

where  Y(s,t)   is  given  by  (2.9)-(2. 11) . 

Proof:   The  proof  is  similar  to  that  of  Henry  [15],  theorem  2. 

Remark  2.2.   The  proof  does  not  use  the  continuity  of  x  and  cp,   so  they  may 
be  taken  to  be  discontinuous  functions  in  BV([a  ,  a),R  )   as  well  as  continuous 
functions;  the  theorem  will  still  hold.   (See  Lemma  2.7). 

Lemma  2.2.   Given  (2.4),  (2.5),  (2.8)-(2. 11),  Y(s,t)   satisfies 

t  t  X 

(2.i4)   y(s,t)  =  e  +  /  d  [u(t,e)]Y(s,e)  +  /  /  a  [T](\,e)]Y(s,e)a\ 

s  s  s 


for  t  <  s  <  t. 

Proof:   Using  the  methods  of  Hale  and  Meyer  [1.4],  theorem  2,  from  theorem  2.4 

t 
above  we  obtain  that,  if  W(t,s)  =  -/  Y(9,t)d0,  then  W(t,s)  =0  for  s  >  t, 

s 
and  for   s  <  t 


10 

t  t  X 

W(t,s)  =  /  d J>(t,0)]W(e,s)  +  /  /   d0[T](X,0)]W(0,s)d\  -  (t-s)E. 

ao  ^  ao 

By  the  bound  in  lemma  2.1,  we  may  differentiate  with  respect  to  s  under 
the  integrals,  obtaining  (2.1^)  after  noting  that,  for  s  >  t,  Y(s,t)  =  0. 

Lemma  2.3.   Suppose  for  some  integer  M  we  are  given  two  (scalar)  functions 

on  [-M, M]  X  [ -M, M],  X(s,t)   and  m(t,s).   Let  X  be  Borel-measurable  in  (s,t), 

of  bounded  variation  and  left-continuous  in  s  for  each  fixed  t, 

var  X(-,t)  <  K,  all  t  e  [-M,M],  X(s,t)  =0,  s  >  t.   Let  m  satisfy  (2.4), 
[-M,M] 

(2.5),  and  be  of  bounded  variation  in  t  for  each  fixed   s  e   [ -M,  M] .   Then 

M+ 
/  d  [X(a,  t)  ]m(a,  s)   is  Borel-measurable  in  (t,s). 
-M 

Proof:   There  exist  Borel-measurable  m  (t,s),  m  (t,s)  >  0,  non-decreasing  in 

+ 
t  for  each  fixed   s,  m  (t,s)  =  m  (t,s)  =0,  s  >  t,   var  m  (t,«)  < 

[-M,M] 

var  m(t,«)  <  5(2M),  and  m(t,s)  =  m  (t,s)  -  m~(t,s).   Hence 
[-M,M]  ' 

M  M 

a)  /  d  [X(a,t)]m(a,s)  =  /  d  [x(a,t)  ]m+(a,  s) 

-M  -M  a 

M+ 
-  /  d  [X(a,t)]m~(a,s). 
-M 

There  exist  simple  functions  m,  ,  given  by  m,  (a,  s)  = 

Nk 
^•_-|av*A  (ats)f    such  that  hl  (a,  s)  ->  m  (a,  s)   as  k  -»  oo.   These  are  deter- 

kj 

mined  by  the  partitions     0   =  a       <  a  „  <  ...    <  a  =   5(2M),    and 

k 

Akj    =   C(«,s):    aRJ  <m+(a,s)   <aR(J+1)},    j   =  l,...,Nk-l, 

AkN      =   ^a^s):    m+Ks)    =   akN   5* 
k  k 


11 


By  the  Lebesgue  Dominated  Convergence  Theorem, 

M+  N       M+ 

b)  /  djx(a,t)]m+(a,s)  =  lim  Z   a   /  d[X(a,t)]X   (a,s). 

-M  k  ->  oo  J    J  _M  kj 

For  each  s  e  [-M,M],  p  €  [0,  8(2M)],  define  u(s;p)  =  min[  (a  e  [-M,M]: 
m  (a,s)  >  p}  U  (M+l)].   Since  m  (*,s)   is  non-decreasing  and  right-con- 
tinuous, u(*;P)   is  well  defined  »  Fix  p.   For  a  e  (-co^-M],  {s:  u(s;P)  <  a}=0, 
which  is  a  Borel  set.   For  a  e  (-M,M], 

{s:u(s;p)  <  a}  =  {s:  there  exists  a  e   [ -M,  a)  with  m  (a,  s)  >  p} 

U    {s:  m+(a,s)  >  p}  =    U    S  (p). 
ae[  -M,  a)  ae[  -M,  a) 

+  + 

Since  m   is  Borel-measurable,  {(a,  s):  m  (a,  s)  >  p}   is  a  Borel  set,  and  so 

its  a-section,  S  (p),  is  also  a  Borel  set.   Assume  a   e        U     S  (p).   Then 
a  ae[-M,a)  a 

there  exists  a.1    e  [-M,  a)   such  that  p  <m  (a',cr).   If  a'   is  irrational, 
since  m  (.,a)   is  non-decreasing  there  exists  rational  a"  e  (a', a)   such 
that  p  <  m  (a", a).   Thus,  if  Ra  =  {b  €  R:  b   is  rational}, 


{s:u(s;P)  <  a}  =    U    S  (p)  =      U     S  (p) 

ae[  -M,  a)        ae[  -M,  a)  ORa 

is  a  Borel  set,  since  it  is  a  countable  union  of  Borel  sets.   Similarly,  for 
a  e  (M,M+1], 

{s:u(s;P)  <  a}  =    U    S  (p)  =      U     S  (p) 

ae[-M,M]        ae[-M,M]nRa 

is  a  Borel  set.   For  a  e  (M+l,°°),  (s:  u(s;P)  <  a)  =  [-M,M],  which  is  a  Borel 
set. 
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Since   {s:  u(s;P)  <  a}   is  a  Borel  set  for  each  a  e  R,  u(*;P)   is 
Bor el-measurable  for  each  (3  £  [0,  S(2M)].   From  its  definition,  u(  s •  • )   is 
non-decreasing  for  each  s  e  [-M,  M].   Using  the  normalization  X(s,t)  =  0 
for  s  >  tj   without  loss  of  generality  we  may  extend  the  domain  of  X(*,t) 
to  [-M,M+1],  for  each  t  e"[-M,M].   Hence,  from  b)  we  obtain 

M+  N.  -1 

c)   /  da[X(a,t)]m  (a,s)  =  lim  [L.=1   a^[  x(  u(  s,a^  .+±^ ),  t) 

-  X(u(s,akj),t)]  -  &M   X(u(s,akN  ),t)}. 


X(u(s,a     ),t)      will  be  Borel-measurable   in     (s,t)      if     (s,t)   ->(u(s,p),t)      is 

kj 

Borel-measurable.      To  check  this,    it   is   sufficient  to   look  at     Q,  = 

C(s,t):    a     <  u(s,p)   <  a       b     <  t  <  b   }      for  all     a     <  a       b     <  b    .      But 

Q,  =  u  ((a  ,a ,),P)  X  (b  ,b  ),  and  u  ((a  ,a  ),P)   is  a  Borel  set,  hence  Q, 

is  a  Borel  set.   Thus  (s,t)  -»  (u(  s,f3),t),  and  also  (s,t)  -»  X(u(  s,a  ),t), 

Nk-1 

is  Borel-measurable.      For  eack     k,    £         a    .[X(u(  s,a   ,  .    -,\),t)    -  X(u(s,a      ),t)] 


is   a  finite   sum  of  Borel-measurable  functions,    so  it   is  Borel-measurable   in 

M+ 
(s,  t).      By  c),      /     d   [X(a,  t)]m  (a,  s)      is  the   limit   of  a   sequence   of  Bord- 


er 

-M 


measurable  functions,  hence  it  is  Borel-measurable  in  (s,t).   The  same  ar- 


+ 


guments  hold  with  m   replaced  by  m  ,  so  by  a)  the  proof  is  done. 

Remark  2.3.  The  simplest  type  of  function  u(t,0)  satisfying  (2.ii),  (2.5) 
and  also  of  bounded  variation  in  t  is  of  the  form  u(t,0)  =  p7(t-0).  This 
form  occurs  in  equations  with  constant  lags  and  constant  coefficients. 

Lemma  2..k.      If  in  lemma  2.1  for  each  0,  u(*,0)   is  also  of  bounded  variation 
on  every  bounded  set  in  R,  then  Y  is  Borel-measurable  in  (s,t). 

Proof:   Add  to  the  induction  hypothesis  of  the  proof  of  lemma  2.1  that,  where 
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it   exists,    Y     is  Borel-measurable   in     (s,t).      This   is  true   for     p  =  0 
(s  >  t),    and   holds   for  the   function     Y°, 


(  Y(s,t)  s  >  t-pC 

Y°(s,t)    = 

I  Y(t-pS,t)  s  <  t-pGo 


k-1 
Then     Y       (a,t)  t](q:,  s)      is  Borel-measurable  in     (t,a,s)«   bv  [8,   theorem  III. 

Mk-1 
11.13],   /  Y       (a,  t)  i"i(a,s)da     is  Borel-measurable   in     (s,t).      By  lemma  2.4, 

•M  k-1 

/  d   [Y        (a, t)]u(a,  s)      is  Borel-measurable   in     (s,t).      Thus   (rewriting  by 

-M  a 


properties   of     Y,    M-,      and      t\) 


k  M+         k   1  M 

Y  (s,t)   =  E  +  /     d  [Y  "  (a,t)]u(a,s)   -  /  Y(a,t)T](a,s)da 

-M     u  -M 


is  Borel-measurable  in  (s,t).   On  the  set  [-M,M]  X  [-M,M]  fl  {(s,t): 

s  >  t-(p+l)£},  Y(s,t)  =  lim  Y  (s,t),  so  on  that  set  Y(s,t)   is  Borel-measur- 

k  ->  oo 
able.   By  induction  and  the  arbitrary  choice  of  M,  the  proof  is  complete. 

Remark  2,k.      Henry  [  15]  makes  the  following  definition: 

2 
Fl  R  -*  Rn   has  property  P  if  F(t,s)  =  Q(t,s)  +   Z     R  (t) 

S+T  (t)<t  V 

where  the  1   (•),  R  (•)   are  continuous,  Z  |R  (t)| 
converges  uniformly;  Q(t,s)   is  continuous,  absolutely  continuous 
in  s,  with  -v-(t,s)   continuous  in  t  for  each  s  and 
|5^(t,s)|  <  q(s)   (all  t)  for  some  locally  integrable  q(  • ) . 

He  then  shows  ([  15],  lemma  2)  that  if  u  has  property  P,  Y  is  Borel- 
measurable  in  (s,t).   It  is  possible  for  F  to  have  property  P  and  not 
be  of  bounded  variation  in  t  on  bounded  sets.   For  example,  if  q(s)   is 
locally  integrable,  r(t)   is  continuous  but  not  of  bounded  variation  on  finite 
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intervals,  then 


F(t,s)  =  Q(t,s)  = 


s  >  t 


-r(t)/  q(a)da,    s  <  t 
s 


has  property  P  "but  is  not  BV  in  t.   The  following  are  two  examples  of 
functions  which  are  of  hounded  variation  in  t,  but  do  not  have  property  P: 

(  0    ,  s  >  t 

F(t,s)    =  Q(t,s)    =        Cantor  ternary  function   of     (t-s),    t-1  <  s  <  t 

(  1  ,  s  <  t-1 

where  Q  is  not  absolutely  continuous  in  s. 


F(t,s)  =  Q(t,s)  = 


0  ,   s  >  t-1 

(t-l-s)  ,   t-2  <  s  <  t-1 

1  ,   s  <  t-2 


wh 


ere  Q,  is  absolutely  continuous  in  s,  hut  ^(t,s)   is  not  continuous  in  t 


Lemma  2.5.   Assume  (2.k),    (2.5),  (2.8) -(2.11),  and  there  exists  a  A>0 
such  that   5(A)  =  0.   Let  tQ  >  aQ  +   A,  and  n(t,0)  =  J(t,0)  +  v(t,9)      be 
as  in  remark  2.1,  where  in  addition  t  <  s  implies  h  (t)  <  h  (s),  and 
a0  <  h/s)  <  s  -  A  for  all  s  e   [tQ,a),  I    =   l,...,p.   Then  Y(s,«)   is 
right -continuous. 


Proof:   For  t  <  s,  Y(s,t)  =  o;  thus  Y( s, • )   is  right-continuous  on 
(-00,  s).   Fix  T  >  s.   By  lemma  2.2  and  the  assumptions  above,  for  t  < 
s  <  t. 
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t 
Y(s,t)  =  E  +  ZP=1a£(t)Y(s,h^(t))  +  /  d  [v(t,0)]Y(s,0) 

s 
t  X 
+  11   d0[Ti(X,0)]Y(s,0)d\. 
s  s 


If  iL  =  sup(|a  (t)|:  t  e  [s,T],  I    =   1,  ...,p}   and'  B   is  the  bound  en  Y 
given  in  lemma  2.1,  for  t<Cs<t<x<T, 

|Y(s,x)-Y(s,t)|  <  |  S^=1  a/T)Y(s,hi(x))  -  Z^  a£(t)  y(  s,  h/ 1)  )| 

x  t 

+|/  d0[v(x,0)]Y(s,0)  -  /  d  [v(t,0)]Y(s,e)| 

s  s 

X  \  t    X 

+  1/  /  d  [T](A.,0)]Y(s,0)dX  -  /  /  d0[T)(X,,0)]Y(s,0)d\| 
S  S  "S  s 


<Z^=1  AT|T(s,hi(T))-T(B,h|(t))|  +  Zvlsl   BY|a£(T)-a£(t) 

T  T 

+  By|/  d0[v(T,0)-v(t,0)]|  +  By  /  m(X)d\. 
S  t 


Since  the  a   are  continuous,  the  second  term  goes  to  zero  as  x  -» t.   By 
assumption  b)  of  remark  2.1,  the  third  term  goes  to  zero  as  x  -»  t.   Clearly 
the  fourth  term  goes  to  zero  as  x  -»  t.   Let  t  e  [  s,  s+A) .   Then,  since 
Y(s,  •)   is  right-continuous  on  (-oo^s),  the  h   are  continuous  and  non- 
decreasing,  and  h  (a)  <  a-A  for  a  >  t  ,  the  first  term  goes  to  zero  as 
x  ->  t.   Hence  Y(  s,  • )   is  right-continuous  on  (-co,  s+A).  We  continue  in 

this  manner,  showing  Y(s,  •)   is  right-continuous  on  (-co,  s+jA)   for  J  = 

T-s 
1,2,  ...,N,  where  N  =  greatest  integer  in  [  — --] .   Taking  one  more  step, 

for  t  e  [s+N  A,T),  we  have  that  Y(  s,  • )   is  right  continuous  on  (-co, t) - 

Since  this  holds  for  each  T  >  s,  the  lemma  is  proved. 
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Lemma  2.6.   Assume  (2. if),  (2.5),  (2.  8) -(2. 11) ,  and  there  exists  a  A>0 

such  that   6(A)  =  0.   Let  t  >  a +A,  and  n(t,G)  =  J(t,0)  +  v(t,0)   be  as 

in  remark  2.1,  where  in  addition  t  <  t  <  s   implies  h  (t)  <  h  (s),  and 

OL  <  h  (s)  <  s-A  for  all  s  e  [t  , a),  £   =  1, ...,p.  Assume  that  for  all 
0  -  ,i  °  t 

w  €  BV([a  ,a),R  )t   t  e  [t  ,a),  the  map  s  -»  /  w(q:)t](q:,  s)da  is  continuous  on 

s 
[tQ,a).   Then,  if  s,t  e  [tQ,a),  Y(s,t~)  =  Y(s+,t)- 

Proof:      Since  the      h       are   strictly  monotone,    the     h  are  well  defined   and 

'  Ju  Xj 

continuous,  £,=   l,...,p.   Thus,  by  the  representation  of  u.,  (2.9)  becomes 
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(2.15)     T(s,t)  =  E  -  7?  /         d  [Y(a,t)]a  (a) 

&~l  [s,t+A]nh^[s,co)  a  * 

t+  t 

+  /  d  [Y(a,t)]v(a,  s)  -  /  Y(a,t)T](a,s)da. 
s  s 

Since  v(a, ')   is  continuous  and  v(s,s)  =  0,  for  each  t  e  [t r.,a) , 

t+  ° 

/  d  [Y(a,t) ]v(a, s)   is  continuous  in  s.   We  have  assumed  that,  for  each 

KJt  i_ 

s  t 

t  e  [t-a),  /  Y(a,t)T](a,  s)da  is  continuous  in  s.   Thus  there  is  a  possible 

s 
discontinuity  of  Y(*,t)   at  any 


s  €  H^t)  =  (h  (t):  £   =  l,...,p), 


at  any 


s  e  H2(t)  =  [h  (h^t)):  j,£   =  l,...,p}, 


at  any 


s  €H5(t)  =  {h.(hJ(h^(t))):  i,j,£   =  l,...,p},  etc. 
Since  h  (t)  <  i-/^    there  are  a  finite  number  of  discontinuities  on  any  finite 

Ju 

interval     [t,t].      By  (2.15)    a  discontinuity  of     Y(*,t)      at      s  <  t      is   given  by 

(2.16)  Y(s,t)-Y(s+,t)    =  &ullY{hJXB),t)    -  Y(h'1(s)+,t)]ai(h-1(s)). 

By  Lemma  2.2^    for     t   >  s  >  t  , 

t 

(2.17)  Y(s,t)  •    E  +  S^a  (t)Y(s,h   (t))    +  /  d0[  v(  t,9)  ]Y(  s,  0) 

s 
t    \ 

+  /•/   dJT](X,0)]Y(s,e)dA.. 
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t 

By  assumption  b)  of  Remark  2.1,  /  d  [v(t,0)]Y(s,  0)   is  continuous  in  t; 

s 
clearly  the  last  term  of  (2.17)  is  continuous  in  t.   Hence,  there  is  a  pos- 
sible discontinuity  of  Y( sf • )      at  those  t   such  that   s  e  H.(t)   for  some 
i  e  (0,1,2,3...}.   Also,  a  discontinuity  of  Y(  s,  • )   at  t  >  s   is  given  by 

(2.18)    y(s,t)  -  T(s,f )  =  E^1ai(t)[Y(s,hi(t))  -  Y(s,h^(t)-)]. 

Fix     t     and      s      in     [t   ,a),    with     t  >  s.      Then     Y(  s,  • )      and     Y(«,t) 

have  the   same  possible  points   of  discontinuity   in     [s,t];    order  them 

t   =  t^  >  x     >  - . .    >  x      =   s.      The  discontinuities   in     Y(*,t)      are: 
0  1  q  \    j    / 


Y(TQ,t)    -  Y(T*,t)    =  E. 

*K,t)    -  T(ft,t)    =  Z  a  (t   ). 

(i:  h/(Tl)  .  x0} 

Y(t     t)    -  Y(T*t)  ,£  [  X  a  (t   )]a  (t   ) 

Cii   h/(x2)   =  T]L)    [J:   h-^x^   =  TQ)   J     °       * 

C*   h/(T2)   =  ro} 

Y(s,t)    -  Y(s+,t)  Z  [  ,E  (-•- 

<i:    hi   <Tq>    "   Vl}    U:    ^   (Vl}    =   V2} 


[i:   hi  (x^   =  xQ} 
(l:  ^  (Tq)   =  x0] 


The  discontinuities   in     Y( s, * )      are: 
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Y(s,Tq)  -  Y(s,t")  =  E. 


iv  q-ly     qJ 

q         1*  W2)   =Vl} 


[      E        a(.   )] 
(J:  h.(x  _)=t  }  J  q  -1 


Ci:  ^(t   )  -t)    *2 


Y(s,t)  -  T(s,t-)  =      E        a*(T0)[     2      a(T){ 

(i:  h/TQ)  =  tx}   °  [j:hJ(T1).T2]  J 

..-[      S  a  (t   )].-•!] 

{i:  h.(T  .)  =  x  }  x  q~x 

iv  q-ly    qJ 
+  ...  +       E         a^(Tn)' 


By  interchanging  the  order  of  summation  in  one  of  the  general  expressions, 

we  see  that  Y(s,t)  -  Y(s,t")  =  Y(s,t)  -  Y(s+,t),  and  so  Y(s,t")  =  Y(s+,t). 

t 
Remark  2.5.   For  the  map  s  -»  /  w(ch)t](q:,  s)da  to  be  continuous  on  [t  ,a) 

s 
for  each  w  e  BV([a  , a),R  )   and  t  e  [t  f  a.) }    it  is  sufficient  that  in  addition 

to  (2.8), 


Tj(t,e)  =  b0(t)«t,e)  +  ^=1bi(t)x[gi(t)](e)  +  Tj(t,e) 
2 

where  b  :  [t  a)  ->  R    is  integrable,  i  =  0,...,q; 


20 


-e,  e  <  t  p 

£(t,9)  -  j  for   (t,e)  €  R  ; 

0,   t  <  0 


X  as  in  remark  2.1j  g   is  continuous  and  strictly  increasing  on  [t  ,  a), 

Jo  U 

QL  <  g/,(t)  <  t   for  t  e  [t  ,  a),  ^  =  l_,...,q*  T](t,  •)   is  continuous  on  [a '■  ,  a) 
for  all  t  €  [t Q,a). 


We  now  consider  a  set  of  conditions  under  which  solutions  exist 


within  the  class  BV([ql,  a),R  ).   For  the  proof  it  is  useful  to  note  that 


ELia/t)x(hi(t))  -  sLia/s)x(Vs))l 

s^-il«i(*)-*i(«)H»«»x[t,.]  ♦^J«i(-)llx(V*))^<V")>l' 


where     ||x||      =        sup  |x(t)|.      Thus, 

t  e   [a0,cr] 


var     Z^_  a  (-)x(h  (•))   <  ||x||      E;_         var     a 
[tpt2]    Z~L  Z  Z  t2  £"x  [tpt2]    i 


+  Z^  ,      sup  |  a  ( s)  |  var  x 

*=1  se[ti;t2]  Cb/V'W1 


under   suitable  assumptions   on  the     a       and     h  ,    as  below. 

Lemma  2 .7 .      Assume   (2.4),    (2.5),    (2«8),    and   there   exists   a     A  >  0      such  that 

6(A)    =  0.      Let     t     >  ql+  A,    and     u(t,0)    =  J(t,0)    +  v(t,8)     be  as   in  remark 

2.1     where  in  addition     t  <  s      implies     h  (t)    <  h  (s),    and     a     <  h  (s)   <  s-A 

for  all     s    e  [t   ,  a),    £   =   1,  ...,p;    the     a       are  of  bounded  variation  on  every 
0  ■" 

bounded   interval;    and  there   exists     L  >  0      such  that 
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/  a Jv(t,e)  -  v(s,e)|  <  L|t-s| 


ao 


Then  there   exists   in     BV([a ,T],R   )      a   solution  to 


Xt      =  *> 
t0 

x(t)    =  cp(t   )    -   /  Ud0[u(t     e)]cp(9)    +  /  d0[u(t,0)]x(0) 

ao  ao 

t      s 
+  /      /     d   [T)(s,0)]x(e)ds      on     [t   ,T] 


0J 


*<><% 


where     cp    e  BV([an, t   ],R   ),   cp      is  right-continuous,"  and     t     <  T  <  a. 

T"t0 

Proof:      For     k  =  1,2,3,...      define     T     =  -— —  ,    and  the   sequence   of  functions 


¥(*)*  t    €    [QU^n^J 


0'    0     kJ 


t  t-T 

:k(t)  -  j  cp(t  )  -  /  °d0[n(t  ,e)]q>(e)  +  /      kde[u(t,e)]xk(e) 

t-T        S 

+  /        k/  d0[r1(s,0)]xk(0)ds,      t   6   (t   +t     T]. 


x   is  right-continuous  on  [a  t +T  ]   since  cp  is;  stepping  over  intervals 
of  size  i       the  continuity  of  g(\|/,  s)   expressed  in  (2.4)  and  the  right-con- 
tinuity of  x,   on  previous  intervals  yields  that,  so  long  as  x   exists  on 
[an,T],  it  is  right-continuous. 

For  t  e  [t  , t  +A],  since   5(A)  =  0, 


*k(t)|    <IM|    +  25(T-a0)||cp||    +/        Km(s)||xk||sds 

to 


Since  the  right-hand  side  is  non-decreasing  in  t, 


t-T        . 
\\x^\t  <  [1  +  25(T-a0)]||cp||    +  /       km(s)||xk!|sds 

t0 


22 


By  Gronwall1  s  inequality, 


t-t 
xk||t  <  [1  +  26(T-a0)]||cp||exp{/        Km(s)ds}. 

t0 


Similarly,  on  [t  +A,  t  +2A],  since  the  second  part  of  ("2.19)  can  1°e   rewritten 


0^0 


tQ+A-T.  t-t 

xk(t)  =  xk(t0+A)-/  d0[u(to+A,e)]xk(e)  *  /     Kd0[u(t,e)]xk(e) 

ao  ao 

t-T  S 

+  /  /     d0[r)(s,e)]*k(e)ds     if     Tk  <Af 

tQ+A-Tk  «0 


we   have 


0  k 

Kllt  <  [i +  25(T-«0>ll|xkl|t0+A +  { +^T  ^KM3  - 

0  k 

t-T 

|| x  ||      <  [1  +  26(T-a  )]||x  ||      +A  exp{/  m(s)ds} 

k  t "  °      k  V*       VA-Tk 

2  t"\ 

<  [1  +  25(T-a ■  )]    ||cp||exp{/         m(s)ds}    . 

T_to 

Now,  if  v  =  1  +  greatest  integer  in  [— — ]}    for  all  k  we  have  by  induction 
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v  T 

HxkUT  <  t1  +  25(T-«0)1      Il9l|exp{/  m(s)ds}    =  Bx, 

t0 

a  uniform  bound  on  the  x  }    as  long  as  thoy  exist  over  [a „, T] 
For  k  >  v   (so  that   x  <  A) }    we  re-write  (2.19), 


Then 


t 
xk(t)  =q>(t0)-  /  °d  [n(t  0)]q>(0)  +  2  xa  (t)xk(h  (t)) 

ao 

+  /  d  [v(t,0)]x  (0)  +  /   k  /  d  [tj(s,0)]x  (0)ds, 
t  e   (t0+xk,T]. 


var       x     =     var       cp. 
[a0,tQ]  [a0,t0] 

var       x     <     var       cp   +  ||x  ||      Tp  var       a 

[a0,t0+A]  [a0,tQ]  t-1  [VVA] 

+     var       cp  jf  sup  |  a  (s)| 

^O'V  S^t0,t0+A] 

+  L^|xk||T   +  /  °+  "Tkm(s)||xk!|sds 
t0 

<  [1  +  S  sup  I  a  (s)|  ]   var       cp 

t    +A-T, 


+  [L     -.  var        a     +  LA  +  /  m(s)ds]B 


Re-writing  (2.19)    again^ 


2k 

tn+A  J? 

Xk(t)    =  Xk(t0+A)    ~   /  d0[n(tQ+A,e)]xk(0)    +  ^a   (t)xk(h   (t)) 

ao 

t  t-T  S 

+  /  d  [v(t,0)]x  (0)    +  /       k     /  d  [tj(s,0)]x  (0)ds, 
ao  V^Vb 

t   e   (tQ+A,T], 


Thus 


var  x     <  var        x      +||x||      T  var  a, 

[a0,t0+2A]  K      [aQ,t0+A]  K  Ki    &'1  [t0+A,t0+2A] 

+         var       x     E  sup  |  a«(s)| 

[a0,t0+A]  ^X   se[t0+A,t0+2A] 

+  LA||xk||T   +  /t0+  A"Tkm(s)||xk!|sds 

<  [1  +  Tp  sup  |a(s)|]      var     cp 

^  sc[t0,t0+A]  [a0,tQ] 

t   +2A-T, 

+  [ff  .         var  a     +  2LA+  /  °  m(s)ds]B 

IX,t    +2A]   *  t„ 

L    0'    0         J  0 

+  T?  sup  |  a  (s)|  {[1  +  L  sup  |a(s)|] 

&~L   se[t0+A,t0+2A]       '  i_1   s€[t0,t0+A]      l 

var     cp 

T)  t     +A-T 

+  [A     n        var  a     +  LA  +  /  U  m(s)ds]B   } 

<  [1  +  L  sup  |  a  (s)|  ]        var     cp 

se^0,t0+2A]  [a0,t0] 


+  [1  +  £,_-,         s^p  |  a   (s)i  ][S_  var 
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t  +2A-T 
+  2LA  +  /        m(s)ds]B  . 

*0 


With  the  equation  re-written  to  begin  with  x  (t  +2A),  we  hav 


kv  0 


var         x     <         var  x     +  ||x  ||      L  var  a 

[a0,t0+5A]  [a0,t0+2A]  ^  [t0+2A,t0+3A] 


+         var  x     L~,  sup  |a.(s)| 

[a0,tQ+2A]    K      '-1   S€[t0+2A,t0+3A] 


+  Mix  ||      +/°  km(s)||xk||sds 


<  [1  +  E;   ,  sup  |  a  (s)|  ]        var     c 

S£[t0,t0+2A]  [aQ,t0] 

+  [1  +  Z!_1        sup  |  a  (s)|  ][Z„ 


i=1  se[tn,tn+2A]      l  ^  [tn,tn+2A] 


0'    0        J  u   0'    0 


t   +2A-T 
+  2LA  +  /  m(s)ds]B 

*0 


+  [E,   ,  var  a     +  LA  +  /  m(s)ds]B 

[t0+2A,t0+5A]  tQ+2A-Tk. 


+  S_!  SUP  |a/s)|([l  +  Z-?  ,  sup 

*-L     S€[t0+2A,t0+3A]  ^X   se[t0,to+2A] 

2 
|  a  (  s)  j  ]        var     cp 


+  [1  +  F&=1         sup  I  a^( s) |  ][^=1 


var  a 

s€[tQ,t0+2A]  "  [t0,tQ+2A] 

t   +2A-T 
+  2LA  +  /  m(s)ds]B  ) 

*0 
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<  [1  +  L  sup  |  a  (s)|  ]        var     cp 

s€[t0,t0+5A]  [a0,t0] 


+  t1  +  2.  -.  sup  |a*(s)|][£^  var         a 

se£  W5A]  ^  VV5A]   i 

,V5A~Tk 

+  3LA  +  J  m(s)ds]B 

*0 


+  S  sup  |a(s)|{[l+E!  sup  |a(s)|]        var    cp 

s<  W3A]  se[t0,t0+3A]  [aQ,t0] 


+    t1    +    £p_i  SUP  la/S)|][^_!  var  a 

s€[  VV5A]  £  W3A] 


t  +3A-T 

+  3LA  +  /  m(s)ds]B   } 

*0 


[1  +  £P.  sup  |  a  (s)|  ]5     var     cp 

S<W5A]  ^O'V 


+    L1    +   £;_i  SUP  lap(s)|l    [S_n  var  a, 

s€[t0,t0+3A]  "  [t0,t0+3A] 


v5A-\ 

+  3LA  +  /  m(s)ds]B   . 

*0 


Continuing  in  this  manner,    for     k  >  v 


var     x     <  [1  +  Z"?_  sup       |a(s)|](       var     cp 

[<VT]  s6[t0,T]  [a0,t0] 


v   -1 

+  [1  +  Z;  S^P       I  a  (s)|  ]  "        [IF         var     a 

'-1   s€[t0JT]  £_i  [tQ,T] 

T 
+  vQL^  +  /     m(s)ds]Bx. 

t0 
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ThUS     [aTt]Xk     "  unifor^  bounded  in     k-VV3*-'      fora11     Wt^T] 
for  which     xk(t)      exists.      But   since   each   of  the     xR     is   of' bounded  variation, 
right-continuous,    and  bounded  by  a  constant   for  as   long  as   it   exists   on 
[a0,T],    the  defining  relation  (2.19)    shows   that     xR     exists   over  all  of 
[aQ,T]      for      k  =   vo,vo+l,...    .      By  Kelly's  theorem,    there  is   a   subsequence, 
which  we   shall  also  denote  by     ^,    and  an     x   e  BV(  [ao,T],Rn)      such  that 


xk(t)   ~*x(t)      as      k  ->  o^    for  all     t   e    [a     T]. 


By  the  Dominated  Convergence  Theorem,  and  the  facts  that 


/   d  |u(t,0)|  ->o  as  k->oo,  and 

*-\ 

t 
/       m(s)ds  ->0     as     k  -»  «     we   have  that,    for     t   e   |"t     Tl 

t-T.  '  L     CK      J> 

k 

t-T.  -h 

k. 


/         d0[u(t,e)]xk(9)   ->/  d  Ju(t,0)]x(0)      as     k  ->  «,    and 


t-T,  S 

k 


t      s 


f  I      deCrl(s,0)]xk(9)ds   -*/      /   d    [T](s,0)]X(0)d 

\         a0  l0  aQ 


as     k  ->  oo.      Th 


us 


*(t)'  t  e  [ao,t0] 

x(t)  =  j  <p(t0)  -  /  %[u(t    e)]cp(0)  +  /  d  [u(t,e)]x(e) 

t     s 


+  /     /     d0[r](s,0)]x(0)ds,      t   e   [t     T], 

t„    rv  *-' 

0 


Jo  a 


and     x     is   the  desired   solution. 
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3.   Qua si convex  Families  of  Functions 

We  now  present  definitions  and  resulting  properties  which  will  form 
the  basis  of  the  proof  of  the  necessary  conditions.   Let 

I  =  [a ■  a)   be  a  bounded  interval  containing  [a  _, t  ], 

'        I'  ■  (tQ,a), 

&     be  a  fixed,  open,  convex  region  in  R   (possibly  all  of  R  )f 

&    be  a  family  of  functions  F:  C(l,^)  X  I1  -*  Rn, 

k         k   i  ^-k   i 

P  =  (a  e  R  :  a  >0  for  i  =  1, .  ..,k  and  L.  _.a  =  1),  k  any 

positive  integer. 

Definition  3. 1.   For  compact  I  C  C([a  , t  ],R  ),  non-negative  K  e  L  (l',R), 
XC^;  let 


C(l,X)    =  Cx  e  C(I,X):  I—  D(x(-),t)|  <  K(t)   a.e.  on  I', 


x   e  *}. 

t0 


Definition  3.2.      A  family    ^    shall  be   called   quasi-convex  if: 

a)  Each     F(x(*),t)    €   &  is     C        in     x     for  fixed     t   e  If      and 
measurable  on     I1      for  fixed     x   €  C(l,-^). 

b)  Given  any     F   e  ^    and  any  compact,    convex     X  C  2? 9    there   exists 

m  €  L  (I',R)      [m     depending  on     X,F]      so  that,    for  all     t   e  V      and     x  6  C(I,X), 
|F(x(-),t)|    <m(t)      and     ||dF[x(  •  ),t;    ,]||    <  m(t)      [i.e.    |  dF[x(  • ),  t$i|r]|    < 
m(t)||\|/||        for     $   e  C(l,Rn)],    where     dF     is  the  Frechet  differential  of     F     with 
respect  to     x. 

c)  For   every  compact,    convex     X     contained   in     & f    compact     ¥  c 
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C([OL.,t  ],X),  non-negative  K  e  L  (l»  ,R) ,  finite  collection  {F. ,. ..  ,F,  }  C  ^, 
0   0  IK. 

k  SI  r 

and  £  >  01   there  exists  for  each  p  €  P   an   FQ  e  -7%   [F_   depending  on 

P  P 

X,Y,K,    the     F.,    and     6],    satisfying 

|F  (*(•)>)!    <E^=1m.(t),      ||dF  [xC), tr]||    <^=1m.(t) 


for  each  p  e  P  ,  t  €  I' ,  and  x  e  C(l,X)   [where  the  m.   are  the  L  (lf,R) 
functions  described  in  b) }   depending  on  X  and  the  F.'],  so  that 


G(x(-),t;p)  ■^.1P1P1(x(.)it)  -Fp(x(.),t) 


2  k 

(c»)   |/  G(x(-),t;p)dt|  <£   for  all  p  €  F%  [t  ,t2]  CP, 


satisfies 

(c») 

T2 
1/ 

Tl 

x  e   C(I,X)?     , 

and 


(c")   if  (P-}M_1   is  a  sequence  in  p^,  so  that  p.  ->p  e  p*, 

00  

then  {G(x( °) ,tjp . ) } .    converges  in  measure  on  I*   to  G(x(°),t$p)   for 
each  x  £  C(l,X)™  „« 

Remark  $.1.   By  the  definition  of  G(x(  •  ),tjp), 


|G(x(-),t,p)|  <  2  Z^=1m.(t)   and 
||dG[x(.),t,p5.]||  <2  ^=1m.(t) 


for  all  x  e  C(I,X),  P  e  P  ,  and  t  e  I*  . 

vk   i 

Remark  3.2.   If  J?    is  convex,  then  it  is  also  quasiconvex,  with  Ffi  =  Z.  _,p  F-. 
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Lemma  3.1.   Let   X  C  Rn,  T  C  C([c^,t  ],X),  K  e  L^I'^R).   Assume  K  >  0,  X  and 
Y  compact,  (2.3)  -  (2.5),  and 

(3.1)    there  exists   A.  >  0,  L  >  0   such  that,  if   s  <  t, 

t 
'  /   |d  [u(t,9)  -  |i(s,e)]|  <  L|t-s|. 

t-X 

Then  C(l,X)     is  a  compact  subset  of  C(l,R  ).   If  X  and  ¥  are  convex, 
C(l,X)^  R  is  convex. 

Proof:   Convexity  follows  from  convexity  of  ¥  and  K  and  linearity  of  D. 
C(l,  X)   is  bounded,  since  X  is  compact.   Let  x  e  C(l, X)„,  .   Then 

|x(t)-x(tQ)|    <  |D(x(.),t)    -  D(x(.),tQ)| 

+  |g(x(.),t)-g(xt   ,t)|    +  |g(xt    ,t)-g(xt   ,tQ)| 


</  K(s)ds   +  |/  d0[n(t,0)][x(0)-x(to)]| 


*0  *0 


♦  Irfxt  ,t)-g(x       tQ)|. 


Choose  x,   0  <  r  <  \,    such  that   6(  y)  <  1.   Let  b  =  [1-S(y)]~  .   Then  if 


|x(t)-x(t  )|  <  5(T)||x-x  ||   +  |g(x  ,t)-g(x  ,t  ) 

t0        t0       *0     ■ 

t 
+  /  K(s)ds 
t„ 


<  5(y)||x-x  ||   +    sup     |gU,t)-g(v|/,t  )| 

^o        te[t0,t0+r] 


\|/    €    ¥ 
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t 
+  /  K(s)ds. 

*0 

Since  the  right  hand  side  is  non-decreasing  in  t, 


x-x  ||   <  5(r)||x-x  ||   +    sup     |g(*,t)-g(i|f,t  )| 

tot  o        t€[t0,t0+r]  ° 

t 
+  /  K(s)ds. 

*0 

t 
■xt  || t  <b  sup  |g(t,t)-g(i|/,t0)|    +  b  /     K(s)ds. 


X' 


The   supremum  is   finite   since     g     is  continuous   and  the   supremura  is  taken  over 
a  compact   set.      For     t     <  t1    <  t  <  t n+T, 


x(t)-x(t')|    <|D(x(-),t)-D(x(.),t')|    +|g(x     ,t)-g(x      ,f) 

t 

+  |/  de[u(t,e)-u(t',e)][x(e)-x(to)]| 

to 

t 

</  K(s)ds   +   sup  |g(^t)-g(i|f,t«)| 
t»  \|re¥ 


to+r 
+  bL|t-t»|[      sup  |g(*,t)-g(i|/,t   )|    +  /         K(s)ds], 

tnt0,to+T]  t0 

♦    €    l" 


By  the  continuity  of  g  and  compactness  of  Y,  the  elements  of  C(l,X)^  „ 
are  equicontinuous  on  [a  ,t  +y].  By  the  Arzela-Ascoli  theorem,  C(l,X)„,  „ 
restricted  to  [a  , t  +y]   is  contained  in  compact  ¥  C  C([a  ,t   +y],X). 


32 


By  the  same  arguments,  we  show  that  C(l,X)™  v     is  equicontinuous, 

and  hence  conditionally  compact,  when  its  elements  are  restricted  to 

a-t 
[ao,to+2y],  [a0,t0+3r],...,[a0,t0+NrL  where  N  =  greatest  integer  in  — -  . 

Then,  as  before,  we  obtain  equicontinuity  on  the  interval  [a  ,  a),  (noting 

that  g  is  defined  for  t  =  a,  and  including  this  value  in  the  supremums). 

By  [  8,  theorem  IV. 6. 5],  C(l,X)v    is  conditionally  compact. 

Let  xJ  €  C(I,X)    ,  j  =  1,2,...,  xJ  ->  x  as  j  ->  °°.   Since  X  is 

compact,  x  e  C(I,X).   Y  compact  and  x^_   e  lf    j  =  1,2,...   imply  that 

x,  £   ?.   |-r-  D(x°(-),t)|  <  K(t),  j  =  1,2,...,   a.e.   on  I'   and  D  con- 

0  d    ~ 

tinuous  imply  that  j  — r-  D(x(  • ),  t)  |  <  K(t)   a.e.   on  I» .   Thus  x  e  C(l,X)™  „, 

so  C(l,X).T/  „  is  closed,  hence  compact. 

Remark  3. 3.   As  an  example  of  a  u.(t, 9)  which  satisfies  (3.1),  let 


H(t,0)  =  E^=1ai(t)X[h<g(t)](0)  +  v(t,0) 

as  in  Remark  2.1.   In  addition,  assume  that  there  exist  X  >  0,  L  >  0   such 
that 

i)  a0  5  h/s)  <  s'^  l  =  V">p»  s  €  ^o'8-)' 

t 

ii)   if  t  <  s  <  t  <  a,   /  d.|  v(t,e)-v(s,6)|  <  L|  t-s|  . 

0  ~  ~      t-x  e 

Then  clearly  (3.1)  is  satisfied. 

Lemma  3.2.   Assume  the  conditions  of  lemma  3.1  hold,  and  o  >  0.   Let 
F.(x(«),t),  j  =  l,...,k,  be  mappings  from  C(l,  X)  X  I'   into  R   which  are 
measurable  in  t  for  fixed  x,  and  C    in  x  for  fixed  t.  Assume  there 
exists  m  €  L  (l',R)   such  that 
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F,(x(.),t)|  <m(t),   ||dP[x(-),t|-]||  <m(t) 


for  all  x  e  C(I,X),  t  e  I1,  j  =  l,...,k.   Let  p.(t),  j  =  l,...,k,  be  given 
non-negative,  real  valued,  measurable  functions  satisfying  Z.^p^t)  =1  a.e, 

on  I* .   Then  it  is  possible  to  subdivide  I*   into  sufficiently  small  dis- 

+    + 

joint- sub-intervals  I.,  i  =  -  1,  -  2.,...,    and  to  assign  to  each  I.   one  of 

the  functions  F,  ,...,F,  ,   which  we  shall  denote  by  FT  ,    so  that  the  function 

1 
given  by  F(x('),t)  =  Fj  (x(-),t)   for  t  e  I  ,  i  =  ±  1,  ±  2, . . mj    and 

i 

x  €  C(I,X),  satisfies 


|/  2  {&     V   (t)F  (x(.),t)  .  F(x(.),t)}dt|  <S 


1 


for  every  T-,>x2  in  I'   and  x  £  c(^x)w  v-« 


Proof:   The  proof  follows  that  given  by  Gamkrelidze  [ 10;  lemma  h. 1]  where  one 

takes  the  compact  set  C(I,X)™  „  as  the  domain  of  the  F.(*,t).   Actually, 

no  use  is  made  of  the  fact  that  one  function  m  e  L  (l',R)  bounds  all  k  of 

the  functions  F.J  the  proof  is  valid  if  the  bounding  function  depends  on  the 
J 

F.   as  in  the  definition  of  quasi-convexity. 
J 

Let  *2r  C  Rr,  Ui  I1  ->  subsets  of  ^  .   Define 


fi  =  {u:  u  measurable  on  Vf    u(t)  e  U(t)   for  t  e  I' } . 


Consider  the  controlled  system 


x   e  0 
t0 


3^ 


|ED(x(-),t)  =  f(x(.),u(t),t)   a.e.   on  I' 


where  <D  C  C([a  ,tQ],  ^),  x  e  C(l,^),  u  e  ft. 


Lemma  $.3.   Assume  (2.3)-(2.5),  (3.1),  f  defined  on  C(I^)  X  <2r  X  I»,  each 
f   is  C   in  x,  Borel-measurable  in  (u,  t).   Also,  given  compact  K^ 
and  u  e  Cl9    there  exists  m  e  L  (lf,R)   such  that  |  f(x(  • ),  u(t),  t)  |  <  m(t), 
||df[x(-),u(t),t;-]||  <  m(t)   for  each  t  e  I1 ,  x  e  C(I,X);  where  df  is  the 
Frechet  differential  of  f  with  respect  to  x.   Then  the  family 

&   =  (F(x('),t):  F(x(-),t)  =  f(x(-),u(t),t)   for  some   u  €  fi) 


is  quasi-convex. 


Proof:   The  assumptions  yield  a)  and  b)  of  the  definition  immediately.   For 
part  c),  we  use  lemma  3.2.   Since  at  each  time  t,   F  (x(»),t)  =  F.(x(«),t), 
j   one  of  {1,  .  ,.,k},  clearly 


|Fp(x(.),t)|  <Z^=1m.(t),   ||dFp[x(.),tr]||  <Zj=1m.(t) 

(c1)   is  the  conclusion  of  lemma  3.2.   In  the  proof  of  lemma  3.2,  I'   is 

divided  into  sub-intervals  I1   in  a  manner  independent  of  the  multipliers 

p.(t).   Thus  the  I*   may  be  taken  as  fixed,  once  given  F,,...,R.   and  S. 

Let  the  I'  .   (the  subset  of  I*   on  which  F0  =  F. ,  meas(l'  .)  = 
a,  i  v  a  p    l*      a,  iy 

/  p.(t)dt)  be  taken  in  order  in  I',  so  that  they  vary  continuously  with 

-_,   1  CL 

a 
6   =  (p,,...,p   ).      Then  by  the  measurable  bounds   on     Fft     and  the     F.,    and  the 

definition  of     G(x(.),t;P),    ( c" )    holds. 
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We  now  set  up  the  main  theorem  to  be  used  in  proving  necessary  con- 
ditions.  Let  y  -   [at]   CI,  t,  >  t  ,  JF  a  quasi-convex  family,  and 
$  c  C([a  ,t  ],^).   For  D   satisfying  (2.3) -(2.5),  define 


(3.2)  Q(tx)  =  {x  e  C(J^):  xt  e  0,  |-D(x(.),t)  =  f(x(.),t) 

a.e.   on  J?   »  =  [t  t  ]   for  some   f  e^]. 


Assume  z  e  C(J^^)   satisfies 


(3.3)  |^D(z(.),t)  =  f*(z(.),t)   a.e.   on  ?  ' , 


f*  a  fixed  element  of  _^  and 

O.fc)  z   =  cp*, 

cp*  a  fixed  element  of  0.   Clearly,  z  e  Q,(  t  ) .   We  denote  the  elements  of 
$-<p*  by  Sep,  and  the  elements  of  [JF]-f*  by  Sf,  where  [3*]      is  the  convex 
hull  of  &.      Let  &   be  the  maximal  convex  set  such  that   cp*  e  &   CO. 
i^-ep*  is  a  convex  set  containing  the  zero  function. 

By  a)  and  b)  of  the  definition  of  quasi-convex  families,  there  exists 
an  n  X  n-matrix  valued  function  T]*(t,0)   representing  the  Frechet  differential 
df*[z(.),t;«] ,  so  that  (2.7),  (2.8)  are  satisfied.   This  tj*  will  be  fixed 
for  the  rest  of  the  discussion.   Let  Y(s,t)   be  the  matrix-valued  function 
described  by  (2.9) -(2. 11)  for  t]  =  t\*.      For  each   &p  e  ^-<p*  and   6f  e  [_F]-f*, 
define   5x(.5Sp,6f)  e  C(J^,Rn)   by 
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(3.5)  Ox(t;5?,5f)    .  Y(t_,t)D(  5p,t_) 


0'    '    x  ^>   0' 

to        t+ 

+  /    d  {-/    d  ry(a,t)]n(a,a) 


t 
+  /  Y(a,t)Tj*(a,cy)da}&p(a) 

t 
+  /  Y(a,t)of(z(«),a)da 
t 
0 


for  all     t   e  3* » ,    and 


(3.6)  5x     (-jSp,8f)    =   Sep.. 

*0 

Now  we  define       JL  C  C(-^,Rn)      by 

(3.7)  -^   =  C  5k(  •  5  8p,  6f ) ,    5cp  e   ^-cp*,    Sf  e  [JH-f*}. 

Since   (3.5)    is   linear   in      Sep      and      5f,    and  both     i^-cp*     and      [JF]-f*     are  con- 
vex,   if     ox.    =  ox(';5cp.,&f .)    e  ~^,    i  =  l,...,r,   then  for     p  e   Pr 

Ei-ipisxi  =  ^-^M-iaPi^i) 
(3.8) 

=  oxC-jZ^/ap.,  ^../sf.) 


is  in    -^\,        Thus     -i   is  c 


onvex. 


Theorem  3. 1.      Given  the  assumptions   above,   D     also   satisfies   (3<>l),    and   a 
finite   set     A  =   ( Sx   , » . .  _,  5x   }  C  J£»   then  for   every     v  >  0     and      £  e   (0.1), 


th 


ere  exists  S'  ,   0  <  £f  £  £,  and  a  continuous  map  0°P  ->Q(t,)   such  that 
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ll-f^  -  Ei=/5xiH  <  v   for  a11  p  -  (e1*  — >Pr)  e  pr" 

(Both  9   and  £f   depend  on  A,  v,   and   £). 

Proof?   By  the  definition  of  ^ ,   there  exist   6f.  e  [j^"]-f*  and   Sep.  e  -^-cp*, 
i  =  1,  ...}y}    such  that   5x.  =  8x(  •  *.  Sep  . ,  6f . )   for  each  i  =  l>#..,r.   Hence 
there  exist  f  ,  ...,f  e  &,    (p.,...,pq)  e  Pq,  i  =  1,...,y,    such  that   of.  = 
S  np<?f.-f*  i  =  1,  ...,r.   For  each  p  e  Pr,  let 

(3.9)       Bk('5P)  =  Z^p1^.,   Qp(.5p)  =  Z^p1^.,  and 

8f(.,.5p)  =  Z^P^f.. 


Then,  for  all  p  £  Pr, 


(3.io)         f*  +  esf(«,-;p)  =  (i-e)f*  +  Z^=1  (Sf^ep^f. 


Since  (l-€)  +  Zr   Zq=  SpXp^  =  1,  we  have  that  f*  +  C5f(  •  ,«  ;P)  e  [J2"],  for 
all  8  €  [0,1]   and  p  e  Pr0   From  (3°5),  (3-6),  (3.8),  (3»9),  and  theorem  20k, 
for  each  p  e  Pr  and  t  e  _Xf , 


t 
(3.11)  Sx(tjp)  =  ap(tn5p)  -  /  °dJ  u(t  ,0)]ap(05p) 


o'K/   J   eL^v  0' 
ao 


t 


+  /  d0[u(t,e)]6x(e;p)  +  /  df*[z("),s;5x(-5P)]ds 

ao  *o 

t 

+  /  6f(z(°);S5p)dSo 
*0 
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Let  X  be  a  compact,  convex,  subset  of  ^;  so  that  z(t)   is  an 
interior  point  of  X  for  every  t  e  J? „   Such  a  set  exists .because  the  closed 
convex  hull  of  (z(t)S  t  e  J?}      is  a  compact  subset  of  the  open  convex  set 
$  C  R  o   J^"  quasi-convex  implies  that  there  exist  functions  m.  e  L  (J^^R), 
j  =  0,1, . ..,q;  such  that 

(3.12)  |f*U,t)|  <m(t),   ||df*0,t5.]||  <m  (t) 


(3.13)  |fj(^t)|    <m.(t),      ||dfd[^t5-]||    <m.(t),      j    =   l,...,q 


for  all     (i,t)    e   C(_^,X)    x/'.      From  (3.9),    (3.12),    (3.13), 

(3.110  |8f(M/,t;p)|   =  \Zl=1  S^p^^t)  -  E^=1pV(^,t)| 

<^=1zi^V±\f.^,t)\  +  |f*u,t)l 
<^(t) 

for  all     p   e   pr,    (\|/,t)    6   C(J^,X)    X  J^1  .      Similarly, 

(3.15)  ||d(Sf)0,f,P;.]||    <S     m  (t)      for  all     p   €   Pq,    U,t)    €   C(^,X)x^' 

Now  let     S    e   (0,1),    K(t)    =  S     m.(t)      for     t   e  _^" » ,    and     ¥  =  con- 
vex hull  of     {cp*,cp    ,.«,.», cp    },   where     cp .    =   Sep .    +  cp*  e   &  Q      By  the  Arzela-Ascoli 
theorem,    Y     is   compacto      From  (3»10)    and  the  definition  of  a  quasi-convex 
family,    there  exist   functions     F(°,°sP,S)    e  J^~,    defined   for  each     p   £   P  , 
satisfying 
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(3.16)  |F(i|/,t;p,e)|  <  K(t),  ||dF[4',tjp,e,-]||  <  K(t) 


for  all  (\|/,t)  e  C(j^,X)  Xj"',  p  e  pr,  S  e  (0,1),  such  that  if 


(3.17)      52f(.,.;p,e)  -p(-,-5P,e)  -  [f*  +cSf(-,-jp)], 


then 


T  2  P 

(3.18)  |/  5  f(x(°),t;p,e)dt|  <6   for  all  [cx,t]C^», 


P  €  P1",  x  €  C(/;X)^K, 


and 


(3.19)      lim   6f(x(°),t;6';S)  =  52f(x(°),t;p;e) 
P»  ->P 


P«  e  F 


in  measure  as  a  function  of  t  over  _^'  ,  for  each  p  6  P  ,   S  e  (0,1), 
x  €  C(>;x)   .   From  (3.9),  (3.17),  (3-19) 


lim   F(x(«),t5P»,e)  =  F(x(-),t;p,e) 
P»  ->p 

P»   €  Pr 

in  measure  as  a  function  of  t  over  ^x ,    for  each  peP,Se(0,l), 

x  e  Q,{Jf jt)        o   Thus,  by  (3»l6)  and  the  Lebesgue  Dominated  Convergence  Theorem, 


(3.20)  lim   |/t[F(x(°)^?P,e)  -  F(x(-),T;p»,e)]dT|  =0 

P'  -P  tQ 

P»  €  Pr 


ho 

uniformly  with  respect  to  t  e  J^'  ,  for  all  p  e  Pr,  Z   e  (0,1),  x  e  C^-^X)™  . 
We  now  consider  the  perturbed  equation 


(3.21)  —  D(x(«),t)  =  F(x(-),t5p,e) 


dt 


=  f*(x(-),t)  +cdf(x(-),tsp)  +  62f(x(-),t;p,e) 


a.e.   on  J^' ,  with  initial  conditions 


(5.22)  *  =  z.  +  csp(-jp)  =  cp*  +  eap(-5P) 


Let  x(«;p,C)   be  the  solution  of  (3-21),  (3.22);  then  from  (3-3),  (3  •**■),    for 

each  t  €  J**      where  x(tjp,e)   is  defined, 


t 

(3.23)       x(t;p,e)  -  z(t)  =  /  d  o(t,e)][x(e;p,e)  -  z(e)] 

ao 

+  D(eap(.5p),t0) 

t 
+  e/  5f(x(-5P,e),s5p)ds 

t 

+  /  [f*(x(-5p,e),s)  -  f*(z(.),s)]ds 

t  2 
+  /  6  f(x(»5P,e),s;p,C)ds. 

*0 


-T 


We  will  show  there  exists  S  >  0  such  that  for  all  C  6  (0,6,],  all  p  €  P  , 

x(t'P,S)   is  defined  on  _X  and  takes  values  in  S^.  This,  together  with  (3.21) 

and  (3.22),  implies  that  x(«;p,C)  e  Q(t  )   for  all  p  e  P2-,  S  e  (0,6  ].   We 
will  also  show 
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e  ->o  x    i 


r 

uniformly  with  respect  to     p   £   P  ,    and 


(3»25)  lim  ||x(.5pt,e)  -  x(.5p,e)||   =0 

P«  ->P  *1 


P'  £  P 


for  all  p  e  Pr,  e  €  (0,6,].   Thus,  given  v  >  0,  choosing  6:  e  (0,6  ]  fl 
(0,£)   appropriately  small  and  setting   8(P)  =  x(°3P,6'),  we  have  that 
8(p)   is  a  continuous  map  of  P   into  Q(t  )   satisfying 


l§M^  -  4#S«  <  v, 


as  in  the  theorem  statement o 

First,  we  show  that  there  exists  6,  >  0  such  that  if  0  <  5  <  6  , 
then  x(t;p,6)   is  defined  and  in  &    for  all  t  e  J* }   p  e  Pr . 

Let  Z  =  {z(t)s  t  €_^},  so  Z  is  a  compact  subset  of  ^,     Also, 
by  the  definition  of  X,  Z  is  in  the  interior  of  XC  ^.   Choose   y  >  0 
such  that,  for  6  as  in  (2„5),  0  <  l-5(y)  <  1.   Let 


t  -+ 
-                       10 
k  =  [greatest  integer  in  ]  +  1, 


b  =  [l-s(r)]"1, 


a  =  [1  +  25(t1-aQ)]b, 


a  =  ^=1l|ap.| 


Choose  c  >  b   such  that 


K2 


sup     a  exp{(b-c)/  m  (s)ds)  <  1, 


Let 


p  =  [kb  +  aa  +  b/  Z?_nm.(s)ds]exp{c/  m  (s)ds}; 
and   p,  >  0  the  distance  between  Z  and  the  complement  of  X»   If 


(3.26)  81  =  min(l,  P1/2p), 


then,  from  (3.22)  and  the  above  choice  of  constants,  for  t  €  [q ,,t  ],  (3  €  Tr , 
and  £  £  (.0,6,], 


|x(t;p,C)-z(t)|  <  p./2, 


Thus     x(t;B,6)      is  defined   and  belongs  to     X     for   every     p   e   Pr,   £    €   (0,6,], 
and     t   e   [q.t   ]<>      Assume  that,    for   some     (3    e   P  ,   8    e   (0,6,],    the   solution  of 
(3»2l),    (3.22)    either  fails  to   exist   on  all  of   J?  ,    or  else   leaves     X.      Let 


t   =   sup{t'    e^*  %    x(tjP,6)      defined   and   in     X     for   all     t   £   [a  ,t*  ]}. 


Denote     [aQ,T]      by  J?  ,    [t    ,t]      by    J?1 .      Thus     x(t;P,6)    £   X     for  all 
t   e   j?  ,    and   from  (3-l6),    (3-21) 


||^D(x(-;p,e),t)|    <K(t)      a.e.    on    J J, 


By  (3.18)  and  the  definition  of  ¥,  for  all  t  e_X*, 


^3 


t   2  -  -  -  -2 

|/  5  f(x(-;P,e),s;p,e)ds|   <e  0 

From  (3-12),    (3  =  1^),    and   (3.23),    for   all     t   €  JT*  , 

t 

(3.27)  |x(t;p,e)-z(t)|  <  |/  d  [n(t,0)][x(e;p,c)-z(0)]| 

ao 

t 
+  |D(eap(.;p),t0)|   +e  /    gj^m^ds 

to 

t  --  -2 

+  /  m0(s)||x(.;P,e)-z||sds  +  e 

to 

t 
<  |/  <a  [n(t,e)][*(e;p,e)-z(e)]| 

t 
+  [l  +  /  °|d  n(t,e)|]||e&p(.5P)|| 
ao 
t 

+  e    f     S  rtm.(s)ds  +  e 

t 

+  /  m  (s)||x(.5p,e)-z||    ds. 


By  induction  we  will  show  that,  for  every  t  e  _X' , 


(3.28)  ||x(-;p,e)-z||t  <  S  p, 


For     t    e   [t0,tQ+r],    by  (3.22) 


t 

/  d  [n(t,e)][x(0;|3,e)-z(e)] 
ao 


hk 


t 
=  /    d  J>(t,e)][e&p(e5p)] 

t 
+  /    d0[M(t,e)][x(e;p,e)-z(0)], 


and   so 


|/  d  [n(t,0)][x(05p,e)-z(0)]|    <  5(t  -a 0)||e6q)(.3P)|| 
0 

+  5(r)||x(«;P,e)-z| 


Hence,    from  (3.27),    for     t   e   [t_,t  +y]j 


|x(t;p,e)-z(t)|  <8(t1-c^)||cap(.;p)||  +  5(r)||x(-;p,e)-z||t 

+  [l  +  6(t1-a0)]||eap(o?p)||  +  e2 
t  t 

+  e/     S-    m  (s)dfl  +  /  m  (s)||x(.;P,e)-z||   ds. 
t       J-u  0  t     0  s 

0  0 

Since     [1  +  28(^-0.)]    >  1,    x(t;p,C)-z(t)    =  e&p(t;p)    for     t    e  [a Q,t    ],      and  the 
right-hand    side  is   non-decreasing  in     t,    this  may  be   rewritten 

t 

||x(.;p,e)-z||t  <  [i  +  28(t1-a0)]!|e5p(-5p)||  +  e  /    ^=om..(3)ds 


0 


+  c    +  /    m0(3)||x(.sp,e)-z||sds 
to 


+  8(r)l|x(-5F,c)-z||t,    t  6  [tQ,t  +rl 


^5 


Subtracting       6(  y)||x(  °  jP,e)  -z||        from  both   sides   and   using  the  definitions   of 
the  constants, 

t 


x(-5P,e)-z|]t  <  be    +  a||eap(»;e)||  +  be  /    Z?0m  (s)ds 


t.     J=u  J 


t 
+  b/  m0(s)||x(o5P,e)-z||sds,     t  £  [t0,tQ  +  r]o 

t 

Gronwall' s  inequality  states  that  if  y(t)  <  X(t)    +  /  u(s)y(s)ds,  X   >  0,  u  >  0, 

t  t 

then  y(t)  <  A,(t)  +  /  A,(s)u(  s)  exp[/  u(|)d|)ds„   If  X     is  absolutely  con- 

a  s 

tinuous  and  non-decreasing,  we  may  integrate  by  parts,  obtaining 


t  t 

y(t)  <  X(t)  -  \(s)exp{/  u(|)d|}| 
~  a 


t        t 
+  /  X(s)exp(/  n(i)d|}ds. 


Since     u  >  0     and      A.  >  0     almost   everywhere, 


t  t  t. 

y(t)    <  A(a)exp{/  n(£)d£}    +  exp{/  jjt(g)di}/   \(s)ds, 

a  a  a 


t 
so     y(t)   <  \(t)exp{/  n(|)d|}. 

a 

Using  this  modified  Gronwall1  s  inequality, 


(3.29)  ||x(«;p,e)-z||,    <  [be2  +  a||t,&p(.;p)' 


t  t 

+  be   /     S     m.(  s)ds]exp{bf  im  (s)ds) 

;     j-o  1  '     •        1    0    ' 


k6 


Now  we  make  the  induction  assumption  that,  for  t  e  Tt^.t  +ky]  C  _X*  , 
k  >  1  an  integer, 

||x(-5P,e)-z(|t  <  [kbg2  +  a||eeq>(.5P)ll 
t  t 


+ 


bC   /  L:  ^m.(  s)ds]expfc  /  di  (s)ds}o 


t     -  ^0 


Let  t  €  [t  +ky,t  +(k+l)y].  At  first  we  assume  a  solution  x(  s;P^£)-z(  s) 

with  initial  function  x   (°j(3,e)-z    at  initial  time  t-y.   Reasoning  as 

t- x  t-y 

before,  a  form  such  as  (3<>29)  clearly  applies,  so 


x(«j0,e)-z||t  <  [be2  +  a||x(-;p,e)-z||t_ 


r 


t  t 

+  be   /     £■:     m.(  s)ds]exp{b  /     m  (s)ds) 


t-r^0  J  t-r° 


Using  the  induction  assumption, 


x(°;p,e)-z||     <  [be2  +  a(kbe    +  a||e&p(.;p)| 


+  be   /       2J:  ^m.(  s)ds}expf  c  /       in  (s)ds) 


t  t 

be  /     LP:  „m.(  s)ds]exp{b  /     m^(s)ds} 
t-y  °        °  t-y 


By  the  choice  of     c,    for     t  e   [t  +ky,   t     +  (k+l)y], 


x(sP,e)-z||t  <  [(k+i)be2  +  a||eap(-;p; 


t  t 

+  be   /     L~  _m.(  s)ds]exp(c   /     m„(s)ds} 
t0  to 


h-( 


Thus,   by  induction  and   the   choice   of     k,  cc ,  and      p,      for     t   e  -Xlj 

t  t 

||x(»5p,e)-z||.    <  G[kb   +  aa+b  /  Z^     m.(  s)ds]exp{c  /     m.(s)ds) 

X,  —  J=U   J  ,  u 

0  *0 

-  e  p, 


which  is  (3.28)0   From  (3.26),  | x(t;p,6)-z(t)|  <  p  /2  for  all  t  6  J? r  ;    in 
particular  x(x5P,S)  e   interior  X.   Combining  (3«l6),  ('3.21) ,  (3.22), 
x(*;P,£)  e  C(J^^X)    ,  which  by  lemma  3.1  is  compact.   Hence  theorem  2.3 
implies  x(°;P,C)   can  be  continued  beyond  t.   Since  x(t;B,S)  e  interior  X, 
this  contradicts  the  definition  of  t. 

We  conclude  that  there  exists  S   €  (0,1],  given  by  (3.26),  such 
that  x(t;p,£)   is  defined  and  takes  values  in  X  for  all  t  s  Jt}   whenever 
P  £  F,  C  e  (0,6,].   By  the  same  arguments,  with  (3  replaced  by  arbitrary 
P  e  Pr,  £  by  arbitrary  8  s  (0,£,],  we  conclude  that  for  all  t  e  _X,  p  e  P1", 


e  e  (0,8-J, 


(3-30)  |x(t;p,e)-z(t)|  < e  p  <  p±, 


and  so 


(3.31)  x(-;P,e)  ^  c(^,x)^K. 


We  now  prove  (3.2^).   From  (3»23),  whenever  t  e  Jf ,  p  e  P  , 


kQ 


(3-32) 


x(t;p,e)-z(t)  =  1  ;    do[ll(t,0)][x(0;p,e)-z(e)] 


a. 


where 


+  D(5cp(.5p),t0)  +/     ef(x(.;p,e),s;p)ds 

0 

1   t 

+  i  /  [f*(x(-;p,e),  s)   -  f*(z(.),s)]ds 

1     t      2 
+  -  /     6  f(x(-5P,e),s5p,e)ds 

*0 


±J    d  [n(t,e)][x(e;p,e)-z(e)]  +  D(ap(-jp),t  ) 


+  /      6f(z(»),s$p)ds  +  \(tjp,e) 
*0 


+  ~  /  df*[z(.),s5x(-;p,e)-z(.)]ds, 
*0 


\(t;P,C)    =  /  [6f(x(-;P,e),s;p)    -   6f(z(-),s;P)]ds 

+  i  /  (f»(x(-5P,e),s)  -  f*(z(-),s) 


-  df*[z(o),s5x(SP,e)-z(0)]}ds 


1     t  2 
+  -  /   5  f(x(-5P,e),s5p,e)ds. 

*0 


Using  (3^15),    (3.18),    (3.30),    and   (3.31), 
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t 
\(t;p,e)|  </  ^=0mJ(s)||x(»56,e)-z||sds 

to 
+  J  f  |f*(x(-;p,e),s)  -  f*(z(-),s) 

-  df*[z(-),sjx(-5P,8)-z(-)]|cls  +  6 

t 

<C[1  +  p  /  XS  m  (s)ds] 

4.     o  u  J 

tl  1 

+  /   -  |f*(x(.3p,e),s)  -  f»(z(-),B) 

-  df*[z('),s5x(.;P,e)-z(-)]|cls. 


We  note  that  the  entire  segment  in  C(J?,&)      joining  x  (°$P,S)   and   z 
lies  in  C([a  ,t],X)   for  all  tei,  M  Pr,  C  e  (0,6  ].   Also,  f*  e  &, 
and  so  is  C   in  x.   Thus,  by  (3»30)  and  the  definition  of  the  Frechet 
derivative, 


lim       |^Cf*(x(.;p,e),s)-f*(z(-),s)-df*[z(-),S5x(.3P,e)-z(.)]}' 


5/iVg°  RWi     lf*(x(-;P,e),s)-f»(z(-),s) 


e  -*o 


-df*[z(.),S5x(-5p,e)-z(»)]| 


=  0  uniformly  with  respect  to  p  e  P   for  all  s  €  J^'  . 


From  (3.12)  and  0.30), 


50 


if*(x(-jp,e),s)    -   f»(z(-),s)    -  dJP*[z(-),s;x(-sP,C)-z(-)]| 


<i  {    sup       ||df*Ux(.;p,e)    +  Cl-i)z(0,sj-]| 

U[0,1] 


+  ||df»[z(-),ss.]||}||x(.5p,e)-z| 


•v-  *-\^ 


<~  {2m0(s)}ep   =  2prn0(s) 


By  these  estimates   and   the   Lebesgue  Dominated   Convergence  theorem, 


lim     X(t;p,e)    =  0     uniformly  with  respect   to     t   e  J^* ,   p   e   P 

e  -^o+ 


Let 


X,(S)  =     max       |  \(t;p,e)| ; 

(t,p)  €  _X«  X  Pr 


note  that   lim  \(e)  =  0.   If 

e  ->o+ 


q(t;p,e)  .  x(t'p-g)  -  z(t>  -  Z?./5r.(t), 


then  by  (3-9),  (3.11),  and  (3-32) 


q(t;p,c)  =  /  d  0(t,e)q(e;p,e)  +  \(t5p,e) 

ao 
t 

+  /  df*[z(»),s;q(sP,e)]ds. 

By  (3«9)  and  (3,22),  q  (»$p,e)  =  0=  Again  choosing  y   >  0  so  that 

t0 
0  <  l-5(r)  <  1,    and  setting  b  =  [l-S(r)]"1,  and  using  (3.12),  for 
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t  e  [t0,tQ+r], 


|q(t;p,e)|  <  5(r)!|q(-sP,e)||t  +  \(e)  +  /  m0(s)||q(-5p,e)|| sds. 

to 

Proceeding  as   in  the  proof  of  (3.28),   we   combine  terms   and   apply  Gronwall* s 
inequality  to  obtain 


q(.5p,e)||t  <  bA,(S)exp{b  /  m0(s)ds},      t   e  [t0,tQ+r] 

to 


For  an  initial  time     cr  >  t        and      t   €   [g,o+y]> 


||q(.;p,e)||t  <  [l  +  6(trQ!0)]||q(.5P,e)||a  +  s(r)l|q(-;P,e)||t 

t 

+   X(S)    +  /  m0(s)||q(-;P,e)||sdso 
a 

t 
q(-5P,e)||t  <  [b(l+6(t1-a0)}||q(-5P,e)||a   +  b\(S)  ]exp{bf  m0(s)ds}. 


a 


Choosing  k  as  before  and  c  >  b   so  that 


t 
sup     b[l+6(t  -a  )]exp((b-c)/  m(s)ds)  <  1, 
teCtQ+^t^        U         t-ru 

the  form  after  the  induction  step  is  that  for  all  t  e  [t  ,t  ],  (3  e  P  } 
e  e  (0,6^, 


t 
q(«5P,e)||.  <  kb\(C)exp(c  /  m.(s)ds}. 


Thus  lim  ||q(  •  ;0,S)||  +   =  0  uniformly  with  respect  to  p  €  P27,  which  is  (3.24). 
S  ->0+         Cl 
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We   complete  the  theorem  proof  by   showing  that   (3.25)    holds;    since 
G   e    (0,£,]      is   fixed  in  the   remainder  of  the  proof,   we  drop  it  as  an  argument 
in     x(t;p,8)      and     F(x( ° ) ,t;P,e) .      Fix     p   e   Pr.        It   follows   from  (J. 21), 
(3.22)    that   for  all     p»    e    pr,   t    £>', 

t 
(3.33)  |x(t;p)-x(t;P')|    <  |/  d0[u(t,e)][x(e;p)-x(e,p')]| 

t 

+  1/  [F(x(.;p),s5p)-F(x(-5p'),s;pM]ds| 

t 
<  ^t;B')  +  |J  "d  [n(t,e)][x(e3p)-x(e,p')]| 

ao 

t 

+  /  |F(x(.5p),s5p»)    -  F(x(.5p»),s;P')|ds 


0 

where,    for     a  =  Z.  _  |  Sep  .  |  , 


4t;p»)  .  a  qBl|p  -P,x|[ l+8(tra0)i 


t 
+|/  [F(x(.;p),s,p)    -  F(x(«5p),s;p«)]ds|. 

*0 

It   follows   from  (3°20)    and   (3.31)    that,    if  we   set     A(p')    =     max     A(tjp' ) 

for  all     p«    €   Pr,    then        lim       ^(p» )    =  0.      By  (3-l6)    and   (3.33),    for     t   z  J?1  , 

PT    -*P 
p1    €   pr 

t 
|x(t;p)-x(t5B')|    <A(P')    +1/     d   [n(t,0)][x(03p)-x(05P')]| 

t 

+  /    K( t)|| x( •  ;p)-x( •  ;p» )||  ds. 
*0 
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Choosing     y     and     b     as  before,    for     t   €   [t    ,t   +y] 


t 

|/  d0[|i(t,0)][x(e;p)-x(05p»)]|  <  o(t1-a0)||5cp(o3p)-ap(.;p')| 
Qo 

+  5(r)||x(-;p)-x(-5p«)llt« 

t 

||x(-;P)-x(o5p»)||      <  2b?XP')    +  b/   K(s)||x(.5p)-x(o;pt)||    ds. 

t 
||x(«;p)-xC5p»)||      <2b^(p»)exp{b  /  K(s)ds}0 


Choosing  k  as  before,  and   c  >  b   so  that 


t 
sup     b6(t  -a  )exp{(b-c)/  K(s)ds)  <  1, 
t€[t  +y,t  ]    X  U         t-y 


we  obtain  by  induction  that,  for  t  e  J?x , 


||x(-;p)-x(.|p»)ll+  <  (k+l)^p»)exp(c  /  1K(s)ds}. 

Thus   lim   ||x(  •  ;(3)-x(  •  jf3'  )||    =  0,  which  is  (3.25),  and  the  proof  is  complete. 
P«  -»p  1 

P  -»  Pr 


h.      Necessary  Conditions 

We  first  formulate  a  control  problem  with  terminal  manifold  in  R  . 

Let   L   , . . . , L_, . . . , L   be  given  real  valued,  C   functions  defined  on 
-[i7        '   07        '   m  ' 

C([aQ,t0],^)  X^  X  [tQ,a),  ^  be  a  quasi-convex  family,  <D  C  C(  [aQ,  tQ]  ,<?), 
and  D(x(-),t)   satisfy  (2.3)-(2.5)  and  (3.1).   Define 


^    =  C(x,t):   t  g  [tn,a),    x  e  Q(t)} 


whe 


re     Q,(t)      is   given  by  (3.2).      Let   the   functions     cp . :  j^  -»  R,    i   =   -u. 


be   given  by     cp±(x,t1)    =  Li(xt    ^(t^,^). 

Problem  4. 1:      We  wish  to  find      (z,t*)    €  JgP    such  that 

a)  cp.(z,t*)    <0     for      i   =   -u,...,-l, 

b)  cp.(z,t*)    =  0     for     i   =   1,  ...,m, 

c)  cp  (z,t*)  <cPr,(x^"t'1)   for  all  (x>"t-|)  € -^  which  satisfy  a)  and  b) 
For  such  a  (z,t*),  let  cp*,  f*,  and  Y  be  given  by  (3-3),  (3«M, 

and  the  remarks  after  (J.k). 

Theorem  k. 1.   Given  the  assumptions  above,  let  (z,t*)  be  a  solution  of 
problem  k.l   sucn  that   z(t*)   exists  and  either  $  =  {cp*j  or  cp*  €  interior  0. 
Then  there  exists  a  row  n-vector  valued  function  \j/  defined  on  [t  ,«>),  and 
real  numbers  a  ,    i  =  -p.,  ...,m,  such  thab 

i)   a  <  0  for  i  <  0,  a  =0  for  all  i  e  {-l;...,-u}  such  that 
cp.(z,t*)  <0,  2^1  al  >0. 

ii)   \|/  is  given  by 
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(4.1)  i(s)    =  1^       a1dL.[zt   ,z(t*),t*;0,Y(s,t*),0] 


^  -o 


where     dL.      is  the  Frechet  differential  of     L. ,    and   satisfies 
i  i' 

(^.2)  i(s)    =0,      s   >  t*, 

(4.3)  ?(t*)    =  2?       alcMzt    ,z(t*),t*;0,E,0], 

l— u  i     tQ 

(h.k)  ?(t*)z(t*)    =  -2?     ..O^dL.Cz     ,z(t*),t*;0,0,l], 

+  * 

t*  t 

(4.5)  M»(s)   =  ¥(**)   +  /       d  I>(a)Ma,s)   -  /     \|/(a)Tj*(a,s)da 

s  s 

for      s    e   [tQ,t*), 

(4.6)  ^(tQ)   =  -^=_^a1dL.[Zt  ,z(t*),t*;Yt  (tQ,-),0,0] 

(note:    (4.6)    need   not   hold   if     $   ={cp*}).      If,    in  addition, 

2!°       a1dL.[z      ,z(t*),t*;  -,',0]    =  0     and     a1  <  0      for     i   e   (-H-....0)      imply 

a     =  0,    i   =  -u, .  ,.,m,    then     \|/     is   non-zero  on  a   subset   of     [t   , t*]      of  positive 
measure. 

iii)      the   following  maximum  condition  holds: 

t*  t* 

/     i(s)f(z(*),s)ds  <  /     ~(s)f*(z(*),s)ds     for  all     f  e    &. 

*0  *0 

Proof:   The  definitions  and  conditions  referred  to  in  the  following  are  con- 
tained in  [22],   Since  (z,t*)   is  a-  solution,  it  is  a  (<P,*,Z)   extremal, 
where 


56 


cp  =  (cp1,...,cpm) 

z  =  ( r  e  R^+1:  r .  ■<  o,  j   =  1,  . . . ,  n+i) . 

j 


Choose  G  £  (o,a-t*)   such  that   z  e  Q,(t*+S)_,  (such  an  £   exists  "by  theorem 
2.3)  and  set  t'  =  t*4€.   Define  Sf     =  Q(t»  )  X  [t  ,t« ].   Let  9/  = 
C([a ,t*  ] }R   )  x  R.   Clearly  condition  60 1  is  satisfied.   By  theorem  J.l 
above,  condition  6.2  is  satisfied  by  M  =  JC  x  [-£,8]   and  ©((3)  = 
(0(p),t*  +  C  Zr_  p1x.)^  where  -^  is  given  by.  (3.7)  and  0(p)   is  the  map 
8 ((3)   of  theorem  3.1.   Theorem  6.4  in  [22]  implies  conditions  6.3  and  6.4 
are  satisfied,  with 


(4.7)       h(y,T)  =  (dL  [z  ,z(t*),t*5y  ,y(t*)  +  z(t*)T,T],.. 

1  ^0  t0 

dL  [z  ,z(t*),t*;y  ,y(t*)  +  z(t*)T,T]), 

m  t0  t0 


(4.8)        h(y,T)  =  (dL  [z   ,z(t*),t*;y  ,y(t*)  +  z(  t*)  t,t]  , . . . , 

0  to        *0 
aL  [z  ,z(t*),t*|y  ,y(t*)  +  z(t*)T,x]). 

By  theorems  6.1  and  5*1  of  [22],  there  exist  vectors  a  e  R   and  a  = 
(a, a"  , oo.,af^)  e  R^"    such  that 


(4.9)  crh(y,T)  +  a«h(t,T)  <0  for  all  (y,x)  e  M, 


(4.10)  |a|  +  |a|  >  0, 
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(4.11)  a1  <  0  for  i  =  0,-l;...;-^ 

(4.12)  cr4>(z,t*)  =  Oo 

From  (4.11),  (4.12)  we  obtain  that  a  =  0  for  all  i  g  (-1, . . .  ,-jj.) 
such  that  cp.(z,t*)  <  0°,   this  and  (4,10),  (4,11)  are  part  i).   Substituting 
(4.7)  and  (4.8)  in  (4-9),  for  all  (y,  t)  e  M, 

£*_  a^L  [z  ,z(t*),t*5y  ,y(t*)  +  z(t*)T,T]  <  0. 

i-u    i  tQ  tQ 

From  (3.7)    and  the  definition  of     M,    for  all     Sep   e  & -<p* ,    of  e   [&]-f*,    and 

t  e  [-e,e], 


(4.13)  2?      axdL.[z     ,z(t*),t*;8p,6x(t*;ap,6f)    +  z(t*)T,r]  <  0. 

i=-u         1     tQ 


Let      Sp   =  0,    x   =  0;    from  (3. 5)    and   (4.13),    for  all     of   €   [J*]-f*, 


g*     ,a1dL.[z     ,z(t*),t*50,   /     Y(s,t*)5f(z(-),s)ds,o]   < 
^  0  trt 


Using  (4,1)  to  define  ty(s),  interchanging  the  dL.  and  the  integral,  and 
noting  that  8f  =  f-f*  for  some  f  e  [3^],  this  becomes  iii).  (2.11)  and 
(4.1)  imply  (4,2),  (2,10)  and  (4.1)  imply  (4.3)  . 

Let   Sp  =  0,  5f  =  0,  t  c   [-S,S].   From  (4.13)  and  (4.3), 

?(t*)z(t*)x  <  -ff   dL.[z   ,z(t*),t*30,0,T]. 

-   l— H  1  tQ 

Since  this  is  linear  and   t  is  symmetric  about  zero,  we  have  (4.4).   Applying 
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(4ol)  to  (2.9),  then  interchanging  the  dL.   and  the  integral,  we  obtain 

(4.5)- 

Now  let      Sf  =  0,    x   =  0.      If     9*   €   interior  §,   there   exists      p  >  0 

such   that   if 


^'    =   (q>    e  C([a0,t0],Rn)S    ||cp-<p*||    <  p},    then     J?*'    C  ^. 


From  (3.5),    (k.13),    and   the   fact   that      -  Sep   €   &*  -<p*     if     £cp   e^'-cp*;    for  all 
&p    e     ^" -cp*, 


^=_^1dLi[zt   ,z(t*),t*5&p,-,0][Y(tQ,t*)D(5tp,t0) 

t"  t*+  t* 

+  /       dffC-/       dQ[Y(a,t*)]u(a,a)   +  /     Y(a,t*)r]*(a,a)da}  &p(a)]   =  0, 

Using  (^-.1)    and   interchanging  the     dL.      and  the  integrals,   we   obtain  for  all 


Z^=    a1dL.[zt  ,z(t*),t*;8p,o,0]   +  Kt0)B(ap,t0) 


t  t*  t*_ 

+  /     da(-/       daU(a)]u(a,a)   +/     Ka)n*(a,a)da)  Sqp(a)   =  0. 

a0  *0  *0 


Let     P  =  {£   e  Rns    J  ||   <   p)o        For  each     £   e  P,    each     (;  e  (a :  ,t   ),   define 


'0'    0' 


&pp    *   e  ^>*-cp*     by 


{k.  Ik) 


*»i,£s)    = 


>    a0  <  s  5  5 


(&%*'   ^s^< 
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Note  that,    for  all   such      t,    Sep,.     Jt)    =   |.      Thus,    setting     Sep    =   Sep      .      in 
the   last   equation,    and  passing  to  the   limit   as      £  -> t   , 


{^=_^ia1dL.[zt  ,z(t*),t*;Yt  (t0,-),o,o]  +  M»(t0)}&  =  0 


for  all  i    e   P.   Thus  the  quantity  in  braces  vanishes,  which  is  (4.6). 

There  remains  only  to  show  that,  given  the  additional  assumption, 
ty  is  non-zero  on  a  subset  of  [t  ,t*]   of  positive  measure.   For  every  x 
C([a  ,t*],R  )   with  ||x  |i  <  p,  define  the  functions  w   on  [t  ,t*]   and 
9X  on  [a0,tQ]   by 


wx(t)  .  ^[D(x(-),t)]  -  df*[z(-),t|x(')]   a.e.  on  [tQ,t*], 

9x  =  Xt  ' 


Then,  by  theorem  2.4,  x  is  given  by 

*o        t+ 

(4.15)  x(t)    =  Y(t  ,t)D(cpx,t  )    +  I  \l-f     djY(a,t)]u(a,a) 

t  t 

+  /  Y(a,t)ri*(a,a)da}<p  (a)   +  /  Y(a,t)w  (a)da. 

XX 

t0  t0 

Define  the  functional  on     C([a   ,t*],R  )    X  R 


L(-,°)    =  ff  =     a1dLi[zt   ,s(t*),t*;-,-] 


From  (4.13)  and  the  fact  that   Sep  e  ^' -cp*      implies  -Sep  e  ^! -cp*,  we  obtain 
that,  for  all  Sep  6  ^2' _cp*,  L(5x( .  ;5cp,0)  ,0)  =  0.   Thus,  from  (4.1)  and  (4.15) 
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t*  _ 
L(x,0)  =  /   4'(s)w  (s)ds.   By  the  additional  assunption  and  (^.10), 

*o 

L(°,0)  fi   0,  and  so  ~(s)  /  0   for  s   in  a  subset  of  [t  ,t*]   of  positive 

measure.   This  completes  the  proof  of  the  theorem.. 

We  now  wish  to  formulate  a  control  problem  with  terminal  manifold 

in  a  function  space  and  a  type  of  "bounded  state  variable"  constraint .   To 

simplify  expressions  we  assume  the  final  time,  T,  is  fixed.   Let  h  e 

[OjT-t-.]:  L  ,  ...,L  ,.oo.L   be  given  real-valued,  C   functions  defined  on 
'       u    -|i      0      m 

C([Q  ,t q],&)    X  C([-h,0],if);  ir     be  a  closed  subset  of  [tQ,T],  g  be  a  real- 
valued  function  defined  on  C([an,T],R  )  X  7/~,  g  and  dg  be  continuous, 
where  dg  is  the  Frechet  differential  of  g  with  respect  to  xj  -^"be  a 
quasi -convex  family;  0  C  C([a  ,t  ] ,  &) ;  and  D(x(«),t)   satisfy  (2„3)-(2. 5) 
and  (3.1).   Define 


-^  =  {x  e  Q(T)},   Q(T)   given  by  (3.2), 
^0  =  C(tt,R), 

ZQ  =  {y  €  fQi    y(t)  <  0  for  all  t  e  tt} 


Z   is  a  non-empty,  open  convex  cone.  Also, 


ZQ  =  {y  e  fQ%   y(t)  <  0  for  all  t  e  tt} 
Let  the  functions  cp .  s  ^->R,  i  =  -u,.»0,m,  be  given  by 


Cp.(x)  =  \{\^_h^),. 
where  x^_h  T  e  C([-h,0],Rn)   is  given  by  xT_h  T(0)  =  x(T+0).   Let  the  func- 
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tion  cp_   ,  i  &   ->  ^   be  given  by 

[cp_[i_1(x)](t)  =  g(x(-),t)   for  all  t  6  tt. 

Problem  ^.2;  We  wish  to  find   z  e^  such  that 

a)  cp.(z)  <  0   for  i  =  -u,..o,-l, 

b)  cp.(z)  -  0  for  i  =  1, .  „ „ ,m, 

c)  cp^^z)  e   ZQ, 

d)  ^(z)  ^^n^^  f'or  a11  x  e  "^  which  satisfy  a)  -  c)» 

For  such  a  z,    let  cp*,  f*,  and  Y  be  given  by  (3«3),  (3°M;  and 
the  remarks  after  (J. 4). 

Theorem  U.2.   Given  the  assumptions  above  and  |i(*,s)   is  of  bounded  variation 
on  every  bounded  interval,  s  e  [a  ,T],  let   z  be  a  solution  of  problem  k.2 
such  that  there  is  at  least  one  t'  e  tt  with  g(z(°),t!)  =  0,  and  either 
0  ={<+>*)  or  cp*  e   interior  $»   Then  there  exists  a  row  n-vector  valued  function 
\|f  defined  on  [t n>°°),  a  real-valued  function  X  defined  on  R,  and  real 
numbers  a,  ,   i  =  -ii,...;m;  such  that 

i)   X.(s)   is  a  non-increasing  function  of  bounded  variation,  con- 
tinuous from  the  right,  \(T)  =  0,  and  X     is  constant  on  each  interval  of 

R\{t»  £  tt:  g(z','),t»)  =  0). 

ii)   a  <  0  for  i  <  0,  a  =0   for  all  i  €  {-u,o..,-l}   such  that 
cp.(z)  <0,  ^Jo1!  +  |A«(t~)l  >0. 

iii)   v|i  is  given  by 
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c».i6)  «.)  ■  ^^i v W^W''01 


where 


T 
+  /     dg[z(.),t;Y(s,«)]dA.(t), 


and  satisfies 

(4.17)  ?(s)  =  0,   s  >  T, 

(4.18)  T(T)  =  ?.^[YVh,r°'WT',)] 

+  d3[z(-),TjY(T,-)]CX(T)-\(T-)}, 

(4.19)  T(b)  -  ^=_/dL.[z   zT_h^S0,E^^T] 


0 

T 


,s. 


+  /_  dg[z(0^;Eb(")]dA.(t) 
s 

T+  T^ 

+  /  d  [\|/(a)]n(a,s)  -  /  \|/(a)T]*(a,s)da,  s  e  [tQ,T), 
s  s 


(0,   t  <  s 
ES(t)  = 

(  E,   t  >  s 


vm    l 


<*.2o)  t(tQ)  ■-^^1adl1[s,VM,Tt(t0,-),0] 


(notes  (i+o20)  need  not  hold  if  $  =(cp*}).   If;  in  addition  , 

S1   pXdL.[z,  ,z_  ,   *•,•]  =  0  and  P1  <  0  for  i  e  {-|i,...,0}   implies 
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P   =  0,  i  =  -u,  ...,m;  and  there  do  not  exist  p  y    i  =  ~n,  ...,m,  p  <0   for 
i  €  (-n, ...,0)   such  that,  for  every  y  e  C([a ,T],Rn), 


0-0  tQ 

then  i'     is  non-zero  on  a  subset  of  [t  , T]   of  positive  measure, 
iv)   the  following  maximum  condition  holds: 

T_  T_ 

/  \|;(s)f(z(.),s)ds  <  /  \Ks)f*(z(-),s)ds   for  all  f  e  {&]. 

t  t 

0  0 

Proof:   Since  z  is  a  solution,  it  is  a  (cp,.4>,Z)   extremal,  where 

z  =  [r  €  r^+1:  r^  <  o,  j  =  l, ...,u+i}  x  zQ. 

Let     j^7     =   &,    %/=  C([a0,T],Rn).      Clearly  condition  6.1  is    satisfied.      By 
theorem  3°1  above,    condition  6„2   is   satisfied  with     M  -  J6   given  by  (3*7)    and 
0      given  by  theorem  3»1»      Fix     x   e  $/<> 

%_x(z4€y)(t)    -  ^-it2)^)    =   g(z(')^y(°),t)    -SU(-)it) 
=  S(z(°)^y(°);t)    -   S(z(-)4€x(0,t) 
+  S(z(«)^x(.),t)    -  -g(z(.),t) 
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=  dg[z(»)-^{ei(t,e,y)y(0  +  [l-01(t,e,y)]x(O},t5 

e{y(-)~x(-)}] 

+  (dg[  z(  • )  4C92(  t,C)x(  • )  ,t5ex(  • )  ] 

-  dg[z(-),t3ex(-)])  +  dS[z(0,t5Sx(o)], 

where  0  <  0,,  0p  <  lo   By  the  continuity  of  dg  and  x,  existence  of  a 
bounded  neighborhood  of  x,  and  uniform  continuity  of  z  over  [a  ,T],  we 
have 


cp    (z4€y)(t)  -  cp    (z)(t) 
lim  +  -=^ s =^ '=  dg[z(0,t5x(.)] 

y  -*  x 


uniformly  in  t  e  7r.   Using  this  and  theorem  6.4  of  [22],  conditions  6„3  and 
6.4  are  satisfied  with 


(4.21)       h(y)  =  (dL1[^Vh,TJ\'yT-h,T1'-"-'dV\'VhfT5yyyT-hiT])' 


(4.22)      h(y)  =  (^^^I^yH^'^^VVHl^to'^I1 

dg[z(-)^!y(')])' 


Thus,  by  theorems  6.1  and  3.1  of  [22],  there  exists  a  continuous  linear  func- 
tional £   e    <5>*     and  a  vector  a   e  R   such  that 


(4.23)  a-h(y)  +  £[h(y)]  <0   for  all  ye  14, 


65 
(k.2k)  if  a   =  0,  then  i  /  0, 

(4.25)  i(0  >  0  for  all  £  e  Z, 

(4.26)  it^z)]  =  Oo 


Since  ^=  R    X  &  ,   there  is  a  vector  a  =  (a  ,a  ,...;a  )  e 

R'   ,  and  a  continuous  linear  functional  i   ..  e  0*     such  that 
7  -u-1   /0 


(4.27)  <&[(r,y)]  =a»r+  ^...^y]  for  each  (r,y)   e  R^+1  x 


Since  (-e.,0)  s  Z  and   (0,y)  e  Z  whenever  e.   is  a  standard  basis  vector 
of  R^"1"1  and  y  e  ZQ,  from  (4.25)  -( 4.27)  we  have 


(4.28)  &       ,[y]  >0  whenever  y  e  Z 


(4.29)  a1  <  0,  i  =  0,-l;...r[i;   and  a1  =  0  for  all 

i  e  [-l,...,-|i)  such  that  cp .  ( z)  <  0. 


(4.30)  %_i[s(z(*)r)]  =  o. 

Also,  by  (4.2l)-(4.23)  and  (4.27), 


(4.31)     ?^[YVh,T"vW  +  VlCdiCz(0)'°5y(')])  ^  ° 

for  all  y  e  M. 
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By  the  representation  of  elements  of  %%,    there  exists  a  function 
X%   R  -» R  of  bounded  variation,  continuous  from  the  right,  constant  on  each 
sub-interval  of  R\ir,  X(r£)    =  0,  such  that 


(4.32)  ^_M_n[y]  =  /_  y(t)d\(t)   for  all  y  e  f    . 

(4„28)  implies  that  A,  is  non-increasingo   From  X     non-increasing  and  (4.30), 
X     is  constant  on  each  interval  J  of  [t  ,T]   such  that  g(z(°),t)  <  0 
for  all  t  e  J  D  w.      Thus  i)  is  provedo   From  (4»24),  (4.27),  and  (4.32), 

Z^_  |aX|  +  |X(t')|  >  0.   Together  with  (4.29),  this  is  ii) .   From  (3-7), 
(4.31),  (^-32),  for  all  Sep  e  ^-cp*  and   5f  e  [JH-f*, 


(*.»)  ^=-/dVZVZ^T^^XT-h,T^^^5f)] 

T 
+  /  dg[z(«),t;5x(»;&p,8f]d\(t)  <  0. 

*0 

Let      £cp    =  0,    Bf  e   [^-f*.      Then  from  (2.11),    (3*5),    and   (4.33), 

T 
^=_iaa1dL.[zt    ,zT_h^;0j     YT_h^(s,«)&f(z(0,s)ds] 
0  tQ 

T  T 

+  /  dg[z(«),t,    /  Y(s,»)Sf(z(-),s)ds]d\(t)    <  0. 

By  lemma  2„3,  Y  is  Borel-measurable.   Noting  that  the  dL.   and  dg  represent 
integrations,  we  apply  Fubini'  s  Theorem  to  interchange  orders  of  integration. 
Thus,  for  all  Sf  e  [^]-f*, 
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jgj   c/dL.t*   z  T.hT50,Y     (s,0]6f(z(.),s)ds 

t0  0 

T  T 
+  /  {/_dg[z(-),t;y(s,.)]d\(t))6f(z(-),s)ds  <  0. 

t0  ^ 

Using  (k,l6)    to  define  l(s)j   this  is  iv) «.   (2.11)  and  (4.  l6)  imply  (^.17) 
By  (2.11),  (kol6)   may  be  rewritten  as 


*(s)  =  g^/dL.tz  VVh,T;0'YT-h,T(s'")] 


T 
+  /_dg[z(-),t5Y(s,.)]d\(t), 
s 


which  implies  ( k. 18) .  Applying  (k„l6)    to  (2.9),  then  interchanging  the 
orders  of  integration  (justified  by  a  theorem  of  Cameron  and  Martin  [  6] ) } 
we  obtain  ( k. 19) . 

Now  let   Sf  =  0.   If  cp*  e  interior  0,  there  exists  p  >  0   such 
that  if  ^'  =  {cp  £  C([a0,t0],Rn)s  ||cp-cp*||  <  p) ,  then  ^'  C  i^0   From  (3-5), 
(4.33),  and  the  fact  that   -Sep  e^'-cp*  if  £cp  e^x-<$*°,    for  all  Sep  e^'-cp*, 

tA[zvzHT;&p',][w(v,)D(^v 

t"     T+  T 

+  '  daC~'  datYT_h;T(^°)]^(a,a)  +  /  YT_h  T(a,-)^(a^)da}&cp(a)] 

a0     *0  t0 

T 
+  /_dg[z(-),t5-][Y(t0,«)D(8p,t0) 

t0 

t"     T+  T 

+  /  da(-/  d  [Y(a,-)]n(a,a)  +  /  Y(  a,  •)*)*(  a,a)da}5cp(a) 

ao    *o  *o    • 

+  5q?('jt)]d\(t)  =  0, 
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where  we  use  the  notation 


(  8p(s),   s  6  [a  ,t  ) 

ap(s5t)  =  o  ° 

(  0    ,   s  €  [tQ,t]. 


Interchanging  the  order  of  the  multiple  integrals  (justified  by  [  6  ] )  and 
grouping  terms, 

T 
^=_^a1dL.[zt  >zT_h,T;ap'°3  +  /_dI[z(»),t°S{)(ojt)]d\(t) 

0     '         t0 

♦tA\'W°'WV)i)(^v] 

T 

+  /_dg[z(-),t;y(t0,-)D(ap^0)]d\(t) 
to 

t~   (   T+   r  n 

+  /  \\'{     dafe-uaidLitzt^T-h,T^0^T-h,T^^)]]^a^) 


T+  r  T 


-  I   d  1/  dg[z('),t5Y(a,-)]dA.(t)  n(a,a)  &p(a) 

t"   i  T 
+  /  da H  ^=-/dLi[zt  'ZT-h^0'Y T.h  T(a,')]^(a,a)da 


0    0 

T  T  ) 

+  /  [J  dI[z(-),t5Y(a,-)]dX.(t)]Ti*(a,a)d.a:[5q)(a)  =  0 

^0  ) 


Using  (K*l6) ,   we   obtain  for   all     £cp   e  Js*  -cp*. 


T 
^=_^a1dL.[zt   ,zT.h  T58q),0]    +  /_dg[  z(  - )  ,t;  &p(  -  ;t)  ]d\(t) 

0  to 


+  ^(t0)D(ap,t0) 
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t~  T+  T 

+/  °  da(-/     dj?(a)]ji(a,a)   +  /  T(a)Ti*(a,cr)da}ap(cx)   =  o. 

a0  ^  ^ 

Define      Sep      .,     by  (4.l4)„      Substituting  this   in  the   last   equation  and   passing 
to  the   limit  as      £  -»  t    , 


fJ?-^aldIiiC«vVhfT»Vto'')'01  +  *(t°m  "  ° 

for  all   |  €  P.   Thus  the  quantity  in  braces  vanishes,  which  is  (4.20). 

There  remains  only  to  show  that,  given  the  additional  assumptions, 
\|/  is  non-zero  on  a  subset  of  [t  ,  T]   of  positive  measure.   For  each  x  e 
C([a  , T],Rn)   with  || x,  ||  <  p,  define  w   and  cp   as  in  the  proof  of  theorem 
4.1;  again  x  is  given  by  (4.15).   Define  the  functional  on  C([a  ,T],R') 

L(')  =  ^=_^a1dL.[zt  ,yh^.,-]  +  ^_M_1{dS[z(-),tr]}. 

From  (4.33)  and  the  fact  that   £cp  e  ^'-ep*  implies  -8p  e  i^»  -cp*,  we  obtain 

that,  for  all  &p  e  ^»  ^p*,  L(  6x(  •  >  £cp,0) )  =  0.   Thus,  from  (4.15),  (4.l6),  and 

(4.32),  after  changing  orders  of  integration  (justified  by  [  6  ]) ,   E(x)  9 

T 
/  \|c(s)w  (s)ds.   By  the  additional  assumptions  and  ii),  L  /  0,  and  so 

*0 

ty(s)  /  0  for  s  in  a  subset  of  [t_,T]   of  positive  measure.   This  completes 

the  proof  of  the  theorem. 


TO 


Remark  4.  1.   If  g(z(-),t)  <  0   for  all  t  e  tt,  then  &  =  0  and  A.(t)  -   0 

for  all  t  €  R.   Hence  /   .  ...dA,(t)  =  0  wherever  it  appears. 

*0 
Remark  4.2.   In  problem  4.1,  the  second  component  of  the  domain  of  the  re- 
straint functions  may  be  taken  to  be  C([  -h,0]  ,&)      as  in  problem  4.2,  rather 
than  ,  $.      Then  in  theorem  4.1  we  must  add  the  hypotheses  that   u(«,s)   is  of 
bounded  variation  on  every  bounded  interval,  and  that   z   exists  on 
[t*-h,t*]   and  is  bounded  there  (since  z  is  clearly  Bor el-measurable,  this 
will  ensure  that  it  is  integrable  with  respect  to  each  of  the  measures  as- 
sociated with  dL.[z,  ,z     j_  v  »t*:0,  •  ,0],  i  =  -u, ...,m).   The  following 
i  t.   ■o*-n,t* 

changes  must  be  made  in  the  theorem  statement:'  In  (4.1),  (4.3),  (^■•6)f    an<3 

the  additional  assumption,  z(t*)   is  replaced  by  z       .   In  (4.1), 

Y(s,t*)   is  replaced  by  Y     +^(s^*)«   In  (^»3),  E  is  replaced  by 

Y..,  .  .„(t*.  •)•   Equation  (4.4)  becomes 
t*-h, t* 

-  ^w^Vv2**-^'*"0'0'11' 

Equation  (4.5)   becomes 


t*+  t* 


+ 


/      dj;^(a)]u(a,c)   -  /     f(a)r)*(a,s)da, 


where     Ee(t)      is  defined   after   (4.19). 

This   type   of  restraint  would  be  quite   natural,    for   example,    if  the 
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system  were  governed  by  —  D(x. ,t)  =  f(x  ,u(t),t),  t  e  [tn, a),  where  x  e 
C([-h,0],  R  ),  x  (0)  =  x(t+0)  for  0  e  [-h,0].  For  such  a. system  one  also 
has  a  =  t  -h. 

The  following  lemma  is  useful  in  problems  with  a  fixed  terminal 
function. 

Lemma  4. 1.   Let  g:  R    ->  R  be  such  that  g(x,t)   and  g  (x,t)   are  con- 

-  ■  -  ,X 

tinuous;    l(t   )      be   a  closed    subset   of     R     such  that     l(t   )    =  1(0)    +  t        for 
t±  6  R     and      I(tQ)    e   [a0,tQ]5  cp _^_1( x^1)    e  C(l(0),R)      be   given  by 
CP-u-l(x^tl)(0)    =  S(x(t1+0),0),    0   e   l(o).      Given  (z,t*)    e  C([ao,a),Rn)    X  [tQ,a) 
such  that      z     exists  and   is   continuous   on  a  neighborhood   of     l(t*)*    then  for 
all     x  e  C([a  ,a),R   ),    x   e  R, 

cp          (z4€y,t*4€a)    -  cp        _(z,t*) 
lim       -dili ZiiZi (e) 

6   -*0+  6 

a  -» t 

y  -»  x 

=  g  (z(t*+0),0)[x(t*+0)+z(t*+e)T] 

.X 


uniformly  in     0  e   l(0)« 

« 

Proofs      Fix     (x,t)    e   C([a  ,a),Rn)    x  Rn»      For  each     0   6   1(0),    if     t   =  t*+d, 


ep  (z+Cy,t*4€a)(0)    =  g(  z(t4€a)-f€y(t-»€a)  ,0) 

=  i(z(t),0)    +   g(z(t)-fCx(t),0)    -   g(z(t),0) 
+  g(z(t)-f€x(t+Ca),0)    -   g(z(t)+Cx(t),0) 
+  S(z(t)4€y(t+Sa),0)    -  g(z(t)4€x(t4€a),e) 
+  g(z(t-t€a)4€y(t-»€ff),0)    -   g(  z(t)+Sy(t4€a)  ,0) 
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=  l(z(t),e)   +  gx(z(t)-Jei1(e,e)x(t),e)ex(t) 

+  gx(z(t)-»€{^2(0,e,o-)x(t)+[l-^2(0,e,cf)]x(t-1€a)},0)«. 

°e[x(t+Ca)-x(t)] 
+  gx(z(t)-t€{^(0,e,cf,y)y(t4€a)+[l-^(e,e,cT,y)]x(t-»€a)},0)- 

oC[y(t+€a)-x(t4ec)] 
+  gx({l4(0,e,cr,y)z(t-t€a)+[l-^(0,e,a,y)]z(t)}-^y(t-»€a),0). 

.[z(t-t€a)-z(t)], 

where  0  <  |.  <  1,  i  =  1,2,5,  lj-.   Thus,  for  each  0  e  l(o), 

cp    (z4€y,t*^cr)  -  cp    (z,t*) 
(4.3^)  — ^ 5 ±d (0) 


where 


=  gx(z(t*+0),0)[x(t*+9)+z(t*+0)T]  +  5(95e,ff,y), 


5(e;e,a,y)  =  [gx(z(t)4€|1(0,e)x(t),0)  -  gx(  z(t)  ,0)  ]x(t) 


+  gx(z(t)+e(l2(0,e,ff)x(t)+[l-52(0,e,a)]x(t4€a),0) 

°[x(t+Sa)-x(t)] 


+  gx(z(t)+e{l5(0,e,cr,y)y(t-fea)+[l-^(0,e,ff,y)]x(t4ea)),0) 


°[y(t+ea)-x(t4€cr)] 

+[gx({^(0,e,a,y)z(t-^a)+[l-^(0,e;a,y)]z(t))4€y(t^o),0) 
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;x(2(t),0)][z(tfg)"z(t)] 


+  gx(z(t),9)[1J/(t,e,a)-z(t)]a 


+  gx(z(t),0)z(t)[a-t], 


and  the  vector  \|/  is  given  by  the  components  \|/.(t,S,a)  =  z.(t+S£,  . (S,t,a)a), 

i  =  l,2,O00_,n,  with  0  <  £.  .  <  1,  i  =  l_,2,.00,n0   Since  g,  g  ,  z,  and  x 

are  continuous,  and  z  is  continuous  on  a  neighborhood  of  l(t*),  we  have  that 

lim   ||£(-se,cr,y)||  =  Oo 

e  ^  o+ 

a   -»  i 

y  ->  x 


This  and  (h,3k)    prove  the  lemma. 

Lemma  4«2.   Let  g,    I  be  as  in  lemma  k<,l,   cp    (x,t  )  =  sup  g(x(t  +9),0)» 

"P*i    L       9el(0)     X 
Given  (z,t*)   as  in  lemma  k»l   such  that  cp    (z,t*)  =  O5  then  for  all  x  e 

C([aQ,a),Rn),    x  e  R, 


cp          (z^y,t*4€a)    -  cp          (z,t*) 
lim       ~^"x Itili 

e  ->o+  e 

a  ->  t 
y  -» x 

=    sug      (g  (z(t*+e),e)[x(t*+e)+z(t*+e)x]}0 

9  €   1(0)      X 

Proofs   The  proof  is  essentially  the  same  as  the  proof  of  lemma  h0ha 

Remark  h0^>0      In  both  lemmas,  if  t*  =  T  is  fixed,  the  term  z(t*+0)x  does  not 
appear  and  it  is  no  longer  necessary  to  require  that   z  exist  on  a  neighborhood 
of  I(t*)8 
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We  now  formulate  a  control  problem  with  a  fixed  function  as  targeto 
Let   h  >  0  be  fixed;;  £S  [-h,0]  ->  Rn  be  C   (see  remark  k0^   below) ,  t,  £  0°, 
W  be  a  diagonal  matrix  whose  entries  are  either  0  or  1,  such  that  W£  -  £; 
L   be  a  real-valued,  C~  function  defined  on  C([a  ,t    ],R  )  X  C([-h,0],R  )  X 
[t  ,Q<)y  y   be  a  quasi-convex  family;  $CC([d,t  ],^)j  D(x(*),t)   satisfy 
(2.3)'-  (2.5)  and  (3.1);  &   =  C(x,t):  t  e  [tQ,a),  x  e  Q(t)},  where  Q(t) 
is  given  by  (3.2);  f.Q   =  C([-h,0],R  );  and  ZQ  =  {y  e  ^Q:  y(0)  <  0   for 
6   e  [-h,  0]}.   Define  the  function  cp  •  <g  ->  R  by 


%(x,\)  =  VvV^v^' 


J0   1  *  1 


and  the   functions     cp  . :  &  -»  ^ '       i   =-1,-2,    by 

cP_1(x,t1)(e)  =  5(e)[g(0)  -  wx(t1+e)], 
cp.2(x,t1)(e)  =  [wx(t1+e)]2  -  [£(e)]2. 

Problem  4.3.   We  wish  to  find   (z,t*)  e  -&     such  that 


a)  q>±(z,t*)  e  ZQ,   i  =  -1,-2, 

b)  cp  (z,t*)  <  cp  (x,t  )   for  all  (x,t  )  e  Sf      which  satisfy  a). 

For  such  a  (z,t*),  let  cp*,  f*,  and  Y  be  given  by  (3.3),  (3. *0, 
and  the  remarks  after  (3. 4). 

Remark  k.  k.      We  note  that  for  any  (x,  t  )   satisfying  a),  Wx        =  £.   To  il- 

1  1  >  1 

lustrate  the  use  of  such  a  W,  where  W  £   E,  suppose  we  have  the  following 

problem  in  C([a  ,T],Rn~  ): 
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,        t 
xt  =  *>   It^(t)  ~  '  de^'.(t,e)]x(0)  )  =  f(x(.),u(t),t). 

0  aQ 

We  wish  to  control  x   so  that  x(t)  s  £(t)   on  [T-h,T]   and  the  cost 

T 
J( u)  =  /  f  (x(  • ),  u(  s),  s)ds  is  minimized.   Assume  the  appropriate  hypotheses 

are  satisfied,  and   f   satisfies  the  same  hypotheses  as  f.   We  then  set 

x  \        /  cp 


'^'  Wo 


fc(t,e)    o\  /f(x(-),u(s),s)> 

n(t,e)  ---        ,  f(x(.),u(s),s)  = 

\  o        o/  \fn(x(-),u(s)^; 

£  =(    L  W  =  I      1  where  I  is  the  (n-1)  X  (n-1)   identity  matrix, 
\0  /       \0  0/ 

Lq(x.  >xT_h  T)  =  xn(T).  The  augmented  problem  is  in  the  form  of  problem  k-,3, 


Theorem  4.$.   Given  the  assumptions  above  and,  for  every  s  e  [a  , a),  u(«,s) 
is  of  bounded  variation  on  every  bounded  interval;  let  (z,t*)   be  a  solution 
of  problem  4.3  such  that  z  exists  on  [t*-h,t*]   and  is  bounded  there,  Wz 
exists  and  is  continuous  on  (t*-h-(3,  t*+{3)   for  some  f3  >  0,  and  either 
$  =  {cp*}   or  cp*  €  interior  $.   Then  there  exist  a  row  n-vector  valued 
function  \|/  defined  on   [t  ,°°),  a  real-valued  function  X  -  2\     -  \       de- 
fined on  R,  and  a  real  number  a  ,  such  that 

i)  X.      is  a  non-increasing  function  of  bounded  variation,  continuous 
from  the  left,  X.(0  )  =0,  X.      constant  on  (-oo^_h]   and  on  (0,«>),  i  =  !>2j 


a     <  0,   |  a  |  +  var   A.  +  var   \„  >  0. 

[_h,co)  [-h,«.) 
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ii)      ty   is   given  by 


(^-35)  *(s)    -«°dL0[zt  ,V-h,t*'t*>'0>V-h,t*(s>,)>0] 

0  + 
+  /      C(0)Y(s,t*+0)dA.(0), 

-h 


and   satisfies 


(4.36)  \|/(s)    =0      for      s  >  t*, 


(**37)  *(t*)  =  rf)dIb[«to,«t»^t#,t*,-O,Tt.^t#(t*,.),0] 

-  S(o)x(o), 


(^.38)  *(s)   =  a  dL0[z,o,zt^^t^t-0,Et^^t„0] 

+  t*+ 

+  f  £(e)Es(t*+0)d\(0)   +  /        dQ[t(a)]^(a,s) 


t* 

-  /     iKa)T]*(a,  s)da 


for  s  6  [t  ,t*),  where  ES(t)   is  defined  after  (4.19), 


{4.39)  a°dL0[zto,zti_h>t<)t-o,^_^t„i] 

o+    . 
+  /    £(e)?(e)d\(e)  =  o, 

-h 
(4. to)  *(t0)  -  -^dyz^z^^t*;!^,.)^] 
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iii)   the  following  maximum  condition  holds: 

t*  t* 

/  \|/(s)f(z(-),s)ds  <  /  ^(s)f*(z(.),s)ds  for  all  f  e^  . 

Remark  k.5.      If  t*  =  T  is  fixed,  (^.39)  does  not  appear  and  it  is  no  longer 
necessary  to  assume  that   £  and   z  exist.   In  most  cases  the  derivatives  will 
exist,  and  the  effect  of  fixing  t*  is  to  remove  the  requirements  that   £ 
and  Wz  be  continuous  and   z  be  bounded.   If  0  =  {cp*),  (4.^0)   need  not  hold. 

Proof:   Since  (z,t*)   is  a  solution,  it  is  a  (4>,Z)   extremal,  where 


*  =  (<P0  -  VQ(z,t*),   cp_1,cp_2), 


z  =  (r  e  R"  r  <  o)  x  z  x  z  . 


Choose  £  e  (0,a-t*)   such  that  z  e  Q(t*+£),  (such  an  £   exists  by  theorem 
2.3)  and  set  t«  =  t*+£.   Define   j^  =  Q(t» )  X  [t  ,t» ],  %/  =  C([a  ,t»  ],Rn)  X  R» 
Clearly  condition  601  is  satisfied©  By  theorem  3<>1  above,  condition  6C2  is 
satisfied  by  M  =  JC  x  [-£,£],  where  -^  is  given  by  (3»7)0   Theorem  6ak   in  [22] 
implies  condition  60k   is  satisfied  for  cp   when 


lKkV  ho(y>T>  "  dVBt  'V-h^*'**'3^  '^.h^^f-h,^^1' 


By  lemma  4»1,  condition  6ak   is  satisfied  for  cp    when 


h_1(y,")(e)  =  -£(e)[wy(t*+e)  +  wz(f*+e)T], 
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an4  for  cp    when 

h  2(y^T)(0)  =  2Wz(t*+8)[Wy(t*+0)  +  Wz(t*+0)T]. 


Since  Wzt#_h  ^  =  £,  ^^_h  ^   =   £,  and   £W  =  £,  these  are 


(hA2)  h_1(y,T)(0)  =  -£(e)[y(t*+e)  +  &(e)-r], 


(4.43)  h_2(y,x)(0)  =  2£(0)[y(t*+e)  +  £(0)t] 


By  theorems  6„2  and  3.1  of  [22],   there  exists  a  non-zero  I    e  Q*     such  that, 
if  h  =  (h0,h_i;h_2), 


(4.44)  £[h(y,T)]  <0  for  all  (y,x)  e  M, 

(4.45)  £[x]  >  0       for  all  x  €  Z« 

Since  Q.    -   R  X  ^  X  ^  ,  there  are  an  a0  €  R  and  functionals 
I  ,  i   e  0-*  such  that 

l(r,03,|)  =  a  r  +  ^_1(a3)  +  ig(5)   for  each  (r,a>,|)  e  §N 


By  the  representation  of  ^n.>  there  exist  functions  X.t   R  -»  R  of  bounded 
variation,  continuous  from  the  left,  \.    =  0  on  (O,00),  \.   constant  on 


(-oo, -h],  such  that  for  cl>  6   ^ 


0' 
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o+ 

i.(co)  =  /  03(9)dA..(e),    i  =  1,2, 
1      -h       X 


Substituting  the  above  and  (4.4l) -(4.43)  in  (4.44)  and  (4.45),  we  obtain 


-  /    £(e)[y(t*+e)  +  £(e)T]dX Ae) 

-h 

0 

+  2/    £(e)[y(t*+0)+£(e)T]d\  (0)    <0      for  all     (y,T)    e  M, 

-h 

0+  0+ 

(4.47)  a°r  +  I    oo(e)d\  (0)  +  /    i(e)d\p(e)  >o    for  ail    (r,<M)  €  z° 

-h  -h 

Since  (-1,0,0),  (0,o),0),  (0,0, oo)  e  Z  if  oo  e  Z  ,  from  (4.47),  a°  <  0  and  the 
X.      are  increasing.   £   is  non-zero,  hence  |a  |  +  var  X     +  var   \„  >  0. 

[-h,«)        [-h,-) 

Thus  i)  has  been  provedo   From  the  definition  of  M  and  (3° 7),  for  all 
&p  €^-cp*,  6f  e  [j5*]-f*,  and   x  e  [-C,e],  letting  \(e)  =  2^(0)  -  X-Xd) , 

(4.46)  is 


(4.48)      aOdL0[Zvzt^^^,t^ap,6xt^hj^(..,5cp,8f)  +  £t#^t.T,T] 

+  /  ^(e)[5x(t^+e;ap,6f)  +  s(0)T]d\(0)  <  o. 

-h 


Let      Sep    =  0,    t   =  05   by  (3.5)    and   (4.48),    for  all     5f  e   [^]-f*, 


t* 

^VV'V-h,^^'0'!     Yt,_^t,(s,0  5f(z('),s)ds,    0] 


+  ..* 


0 
0^  t"r 

+  /    £(0)/     Y(s,t*+0)6f(z(°),s)ds  d\(0)    <  0, 
-h  t0 


8o 


By  lemma  2.3,  Y  is  Borel-measurable.   Interchanging  dL   and  the  integra] 
in  the  second  term,  and  defining  \J/  by  (4.35),  this  is  iii) .   (4.3o)  and  (4.37) 
follow  from  (2.10),  (2.11),  and  (4.35).   Applying  (4,35)  to  (2.9),  then 
changing  orders  of  integration  (justified  by  [6]),  we  obtain  (4.38). 
let   Sep  =  0,  Sf  =  0,  t  e  [-6,6];  then  (4.48)  is 


a°dLo[zt^V-h,t^^°°'V-h,t^T'T] 

-h 


Since     t     is   symmetric   about   zero,    this  implies   (4.39)° 

Now  let      5f  =  0,    t   =  0.      If     cp*  e   interior  $,    there   exists      p  >  0 
such  that   if    f?  *    =   (cp   e   c([a  ,t   ],Rn)S    ||cp-cp*||    <  p} ,    then      ^'   C      ^.      From 
(3.5),    (4.^3),    and   the   fact   that     -Sep   e  ^ » -cp*     if     Sep   e  ^  '  -cp*5    for   all 
Sep   e  ^'  -<p* 

AVvv-h't*'**58P'0'01 

+  a°dL0tz    ,V_hjt„t*;o,-,o][Yt,.hjt#(t0,-)D(ap,t0) 

«n  *n  t0 


t)  0 


o+      -  t~         ^+ 


+  /   5(0)ry(tn,t*+0)D(8p,to)    +  /  %[-/       djY(a,t*+9)]u(a,a) 


-b        L      u  «o         *o 


t*  -I 

+  /     Y(a,t*+9)T]*(a,a)da}ap(a)Jd\(e)=0. 


0 


Changing  some  orders  of  integration  and  using  (4.35)  this  ii 


8l 


adLo[zt  'V-hjt*'**'8*'0'01  +  ,^to)D(&p'to) 

t"         t*+  t* 

+  /     da(-/       da[i|/(a)]|i(a,a)   +  /     ^(a)r]*(a,a)da}5p(a)   =  O0 

a0  %  *o 

Define   &p     by  (40l^-)c   Substituting  this  in  the  last  equation  and  passing 

to  the  limit  as  v  -»  t  , 


for  all   |  e  Po   Thus  the  quantity  in  braces  vanishes  which  is  (J+O4o),  and 
the  proof  is  complete. 

Remark  j4-«6„   The  conditions  of  theorem  k<,~5   will  be  satisfied  if  a0  =  0, 
X       is  any  function  satisfying  the  restrictions  in  i),  and   A,  =  2\   „   The 
examples  in  chapter  6  will  show  that  there  are  cases  in  which  a  non-trivial 
maximum  principle  is  given  by  theorem  k<,3°   but  they  also  require  that   £(9)  /  0 
at  points  9     where  X     has  a  jump,  further  restricting  the  class  of   £  which 
can  be  used  as  target  functions<> 

Remark  U„7  .   Problem  k-.J   may  be  expanded  to  include  more  restraint  functions 
L.   as  in  problems  k.l   and  ^.2.   The  corresponding  dL.   will  then  appear  in 
\|/  as  in  theorems  k.l   and  k*2.      The  additional  L.   may  be  used  to  restrain 
coordinates  of  x  not  specified  by  £,  as  well  as  to  define  an  initial  mani- 
fold in  C{[aQ,tQ],&). 

Remark  k,Q.  .   The  general  method  of  proof  used  above  can  be  applied  to  obtain 
necessary  conditions  for  a  wide  variety  of  constraint  functions.   In  particular, 
there  are  many  functions  which  do  not  have  a  Frechet  derivative,  yet  satisfy 
the  requirements  of  [22]  (see  [21]  and  [22]  for  examples). 
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Remark  ^9'   Theorems  k<,2   and  4»3  use  the  same  method  of  treating  the  bounded 
state  variable  constraint  based  on  g0   In  [21,  section  8],  Neustadt  also  gives 
a  method  of  treating  bounded  state  variable  constraints  by  a  supremum  function 
This  treatment  of  problem  h<,3   is  presented  below  for  completeness!  the  non- 
linear maximum  principle  it  produces  is  very  difficult  to  work  with«   In  ad- 
dition, due  to  the  non-linearity,  although  a  pointwise  maximum  principle  is 
implie d by  the  integral  maximum  principle,  one  can  give  examples  where  the 
pointwise  maximum  principle  does  not  imply  the  integral  maximum  principle,, 

Let  h,  £,  W,  L  ,  -i^,   0,  D,  and  JgP  be  as  in  problem  ka^0      Define 
the  functions  cp .  I   Jc^->R,  i  =  -2,-1,0,  by 


cp^x,^)  =  L^x^x^^,^), 
0 

9  n(x,t  )  =  /  5(e)[g(e)  -  wx(t  +e)]de, 

-h 

cp      (x,t   )    =     sup        {[Wx(t   +9)]2   -   [^(0)]2) 
1       0e[-h,O]  L 


Problem  K.^:      We  wish  to  find      (z,t*)    e  if    such  that 

a)  cp.(z,t*)    <  0,      i   =   -2,-1 

b)  cp0(z,t*)  <cp0(x,tx)   for  all  (x,^)  e  if  which  satisfy  a). 

For  such  a  (z,t*),  let  cp*,  f*  and  Y  be  given  by  (3.3),  (3-M, 
and  the  remarks  after  (3.^). 
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Theorem  k.h-.      Assume  the  conditions  above 5  u  satisfies  the  conditions  of 
lemma  2.6  and  lemma  2.7  j  either  p  =  1  or  h  (t)  =  t-d  ,    $,   -   1,...,P5  v(-,s) 

Jo  Jo 

is  of  bounded  variation  on  bounded  intervals  for  each   s  e  [a  ,  a)*  and  for 

each  T  e  [t-,a),  t  €  [a  ,T]0  C  >  0,  there  exists  p(e,T,T)  >0  such  that 

I  t-x\    <  p(C/r,T)   implies   |  v(  s,t)  -v(  s,  t)  |  <S   for  all  s  e  [t  ,T].   Let 

(z,t*)   be  a  solution  to  the  problem  such  that  z  exists  on  [t*-h,t*]   and 

is  bounded  there,  Wz  exists  and  is  continuous  on  (t*-h-(3,t*+f3)   for  some 

P  >  0,  either  <±>  =0?*}  or  cp*  e  interior  0,  and  for  all  w  e  BV([a '  ,a),R  ), 

t 
t  e  [t   ,a.)  j    the  map  s  -»  /  w(a)rj*(a;  s)da  is  continuous  on  [t  ,a).   Then 

s 

there  exist   functions     \|/s    [t    ,°°)   -»  R  *      and     \|f.  8    ["t^,00)    x  [-h,0]   ->  R     ,    and 
real  numbers     a  ,a     ,a         such  that 


i)     a1  <  0,   i  =  0,-1,-2°  E°__2|a1|    >  0» 
ii)      \|/     and     \|),      are   given  by 


*(s)    -  aOdL0[zt^zt^^t^t-0;Yt,_h^t,(s^),0] 

-  a    /   £(0)Y(s, t*+0)d9, 
-h 


Vs'0)  =  2tteMs,t*+e), 


and   satisfy 


\|/(s)    =0      for      s  >  t*, 


\l/   (s,0)    =0      for      s  >  t*+0, 


Qk 


*(f)    =  a  dI^[B     ,V.hft#,t» ;o,Tt..^t»(t» ,.),0] 


i|/   (s,0)    =  2£(0)      for      s   =  t*+0, 


♦(s)    =  a°dL0[zt^zt^h^^t^O,Et^^^,0] 


0  t*+ 

-a"  /    £(e)Es(t*+e)de  +  /     d  r\|/(a)]ti(a,s) 

-h  s         u 


t* 
-/     *(a)Tj*(a,  s)da     for     s  €   [t  ,t*), 

s 


where     ES(t)      is  defined   after   (^.19), 


t*+  t* 


s 


for     s  e  [t   ,t*+9), 


0  -h 


e   co{-2cf2£(0)£(0)s    0   e   [-h,0]}, 


where  co  denotes  closed  convex  hull, 


e  cS[{-a"  ^(1^,9):  e  e   [-h,0]J  U  t-a'S^t  ,6"):  9e[-h,0]}] 
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iii)   the  following  maximum  conditions  holds? 

t* 
/  t(s)[f(z('),s)  -  f*(z(-),s)]ds 

*0 

p  ** 

<|a  |   sup   {/   Us,0)[f(z(»)..s)-f*(z(O,s)]ds} 

0e[-h,O]  tQ 

for  all  f  e  ^. 

Remark  ^-.lOo   The  proof  follows  the  same  pattern  as  the  three  given  above  and 
will  not  be  presented  here   The  proof  of  the  last  condition  in  part  ii)  in- 
volves interchanging  a  limit  and  a  supremum"  it  is  quite  tedious,,   If  0  ={q)"*}; 
this  condition  need  not  hold,  and  the  assumptions  on  u.  and  tj*  in  the 
statement  of  the  theorem  may  be  replaced  by  the  assumption  that  u( ° ,9)      is  of 
bounded  variation  over  bounded  intervals  for  6  £   [oc  )Q-)o 

t 
Remark  4»IL   Conditions  for  the  map  s  ->  /  w(a)T]*(a,  s)da  to  be  continuous 

s 
for  all  w  e  BV([a  , a),R  )   were  given  in  remark  2,5.   One  obtains  an  r\* 

as  specified  there  if  the  quasiconvex  family  has  elements  of  the  type 


f(x(-),t)  =  f(x(t),x(g1(t)),x(g2(t)),...,x(  g  (t)) 


t 
/  d@[?,(t,e)]G(x(e),e),t), 

ao 


where  the  g   are  as  in  remark  2„5^  t]     satisfies  the  same  hypotheses  as  r\ 
in  remark  2„5,  and  G  is  C   in  x  and  Borel-measurable  in  to 
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5.   Sufficient  Conditions  and  Existence 

We  present  two  types  of  problems  for  which  the  necessary  conditions 
of  Chapter  h   are  also  sufficient  conditions.   Suppose  for  fixed   T  >  t   we 
are  given  the   n-1   equations 


t  t 

(5.1)         dt[x(t)  "  '  de[u(t,0)]x(e)]  =  /  d  [Tj(t,0)]x(0)  +  k(u(-),s) 

ao  ao 


a.e.  on  [t  ,T], 


(5.2)         x   =9,  cp   a  fixed  element  of  C([a  ,t  ],R  "  ); 
t0  0  0  ■  ■ 


the  set  of  restraints 


(5.3)  Xi(XT-h  T^  =  °'   i  =  1>'">m> 


(5.*0       u  e  fi  =  {v:  v  measurable  on  [t  ,T],  v(  s)  e  U(s)   for   s  e  [t  ,T]) 


where   ^  C  Rr,  U:  [t  ,T]  ->  subsets  of  %  j 

3  0' 


and  the  cost  function 


T 

n,— ,  .   >    ,  n. 


(5.5)  J(u)  =  g(xT_h^T)  +  /  [f  (x(s),s)  +  ktl(u(-),s)]ds. 

to 

Let     u      satisfy  (2,h)J    (2.5),    and   (3.1),    M-(*;s)      be   of  bounded  variation  on 
[t   ,T]      for  ail     s   e  [a  ,T];    T]      satisfy  (2.8)  j    k     and     k       measurable   in     ( u,  s), 
|k(fi,  s)|     +  |kn(fi,s)|    <M(s)      for      s    e   i^Qt^t    M   e   L  ([t    ,T],R);    L.      be   linear, 
i   =   l,...,m,    (L.:    i   =   1, . . .  ,m)      be   linearly  independent;    f  (y,  s)      be      C       and 


87 


convex  in  y  for  each  s  e  [t,T],  measurable  in  s  for  fixed  y  €  R   } 

and  for  compact  X  C  R     there  exists  m  e  L  ([t  .T],R)   such  that 

dfn 
|fn(y,s)|  <mn(s),  I— z_— (y,  s)|  <mn(s)   for  y  e  X,  s  e  [t  ,T]j  £(♦)   be   C1 

dx 
and  convex  in  {■  e  C([-hjO],R   ). 

We  now  augment  the  system/  setting  x  =  (x,x  )f    x   =  ("PjO), 

0 

k(u(0,s)  =(k(u('),s),  kn(u(.),s)),  f(x(.),B)  =  (/  de[T1(s,0)]x(0),fn(x(s),S)), 

ao 

and  g(xT_h  T)  =  i(xT_h  T).   Assume  that   &  =  {F:  F(x('),s)  =  f(x(-),s)  + 
k(u(«),s),  u  e  0,}      is  a  quasi-convex  family.   (For  example,  satisfies  the  hy- 
potheses of  lemma  3.3.   If  k  is  linear  in  u,  there  may  be  delays  in  the 
control)  see  Banks  and  Jacobs  [2]).   The  augmented,  problem  is  a  special  case 
of  problem  k.2,   where  \(^t   >xT_h   T)  =  \(*T-h  T^  ±   =  L'  *  *  * >m>    and 

Ln(x  ,x     )  =  g(x     )  +  xn(T). 
0  tQ  T-h,T       T-h,T 

Theorem  5.1.   Given  the  assumptions  above  and   u  e  0,     with  response  z   satis- 
fying the  necessary  conditions  of  theorem  k.2;   then  if  a0  £   0,  u  is  an  optimal 
control. 

Proof:   Note  that  the  assumptions  of  theorem  k.2   are  satisfied.   Let  Y  be  the 
n  X  n  matrix  solution  of  (2. 9) -(2. 11)  where 


u.(t,e)    0  \  I    0  9   >  t 


n(t,e)  =1        I,  n(t,e)  =, 

\  o    o/       lh(t,e) 


; 


•^(z(t),t) 

ax   . 


,  €  <   t 
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and  x  be  the  response  to  a  control  v  e  0,      such  that   L.(x     )  =  0, 

l     T-n,T 

i   =   l,...,m.      Since     dg[zT_h  T;-],    dL±[zT_h  T;  •  ] ,    i   =   1,  . . .  ,m,    are   continuous 
linear  functionals   on     C([-h,0],R   ),    there  exist      A,.:    R  ->  R     ,   i  e0,...,m,    of 
bounded  variation,    continuous   from  the   left,    \.(s)    =0,    s  >  0,    and      A,.(s)    = 
\.(-h),    s  <  -h,    i   =  0,...,m,    such  that   for  any     y   e   C([-h,0],R   ), 

0+  0+ 

dg[^_h  T;y]    -  /     d[\(0)]y(0),    dL.[z  ;y]    =  /     d[X(0)]y(0), 

'  -h  '  -h 

i  =  1, . . . ,m.   Also,  since  neither  g  nor  any  of  the  L.   depend  on   z  , 
X.(s)  =  (A-.(s),0),  s  e  R,  i  =  0,...,m.   Hence,  for   4   given  by  (^.l6),  from 
( k. 19)  we  have 

T+  T 

(5.6)  \|r(s)  -  /  d[\|/(a)](i(a,  s)  +  /  \|/(a)T)(a,s)da 

s  s 

T+ 

=  a°{/    d[ye-T)]  +  (o,...,o,i)) 

s 
+  g^tf1  I     d0[X.(0-T)L   s  e  [tQ,T]. 


By  the  form  of  the  a..,  u,  and  r\,    for  each  s  £  [t  ,T],  <|f  (s)  =  a  . 

Since  x  and   z   satisfy  the  augmented  equations  (5.1),  (5-2), 

0  -  /  d[i|/(s)][x(s)-z(s)]  -/  d[*(s)]j/  d.[n(s.8)][x(e)-z(0)] 

,+ 


+  /S  /T  de[(o(ff,6)   o)][x(0)-z(0)]dCJ 

to  to 

+  /s  I  I d° 

tQ  \fn(x(a),a)  -  fn(z(cr),a)/ 
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s  \ 

+  /  [fcK.),<j)-k(u(-),tr)]ao[  . 

*0  ' 

o=/    a[t(e)][x(e)-z(e)]  -  ;    d[+(s)]J    d.[n(s,e)][x(e)-z(e)] 

*0  *0 

T+  s      TH' 

-  /     d[t(s)]{/     /     d   [i](a,e)][x(e)-z(e)]da) 

T+  s/  0 

-   /     d[1r(s)]/ 

dx 

T  s 

-  /     d[iKs)]J  [k(v(-),cr)-k(u(-),ar)]da. 

0  0 


Integrating  by  parts  and   noting  that     \|/(T   )    =  0, 


m+  m+  m 

o  =  /    d[y(8)][x(e)-z(e)]  -  /    d[*(s)]/    d  [n(s,e)][x(e)-z(e)] 

T  T  + 


+  /     M/(s)/     do[Ti(s,0)][x(0)-z(0)]d: 


*0 

♦   A(8)|  ^  ]dS 

*0  \fn(x(s),s)-fn(z(s),s)-  2L.(z(s),s)[x(s)-z(s)]/ 

dx 

T 
+  /  *(s)[k(v(-),s)-k(u(0,s)]ds. 

Changing  some  orders  of  integration  and  using  \|r  (s)  =  QL  f 

0  =  /  d0{i|f(0)-/  d[>(s)]u(s,6)  +  /  \|/(s)T)(s,0)ds)[x(0)-z(0)] 
t0        t0  t0 
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o 
By  (5.6), 


+  a°/   {fn(x(s),s)-fn(z(s),s)    -  — (z(s),s)[x(s)-z(s)]}ds 
tQ  fc 

T 
+  /  f(s)[k(v('),s)    -  k(u(-),s)]ds. 
t. 


T  + 
0   =  a°{-/     d   [A.  (0-T)][x(8)-z(0)]    -   [xn(T)-zn(T)J} 

-  2? 


;.=1a-  /    d0[x.i(e-T)][x(e)-z(e)] 


*o 


afn,-, 


a°   /   {fn(x(s),s)-fn(z(s),s)-  £i-(z(^),s)[x(s)-.7(s)]}ds 


T 
+  /   t(s)[k(v(-),s)    -   k(u(-),s)]ds. 

*0 


By  the  definition  of  the      A..,    linearity  of  the     L.,    and  the   fact  thai 


0   =  a°t-<3g[zT_M;xT_h)T-ZT_h)Tl    -    [Xn(T)-zn(T)]) 

T  n 

+  d°  I   {fn(x(s),s)-fn(z(s),s)    -  ^-(z-(s),s)[x(s)-z-(s)]}ds 

t0  ax 

T 
+  /   \|/(s)[k(v('),s)    -   k(u(-),s)]ds. 

*0 

Since     a     £  0.    we  may  assume     a     -   -1; 


J(u)-J(v)    =   g(zT_h  T)    +   zn(T)    -   g(xT_h  T)    -   xn(T) 
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=  -teCVhjT^Vh,^3  +  zI1(T)  "  xtl(T) 


"{-dg[ZT.h,f,XT.h,T"Vh,T])  "^^  -  ^^ 


T  n 

-  /  {fn(^(s),s)-fn(z(3),s)-  ^~(z(s),s)[x(s)-z(s)]}ds 

t0  ax 


T 
+  /  t(s)[k(v(.),s)  -  k(u(-),s)]ds. 

J- 

°0 

By  the  convexity  of  g,  convexity  of  f  (m,s)  for  each  s  e  [t  , T],  and  the 
assumption  that  u  satisfies  the  maximum  condition,  j(u)-j(v)  <  0.  Thus  u 
is  an  optimal  control. 

Remark  5.1.   If  we  are  dealing  with  the  free  endpoint  problem,  the  necessary 
conditions  ensure  that  a     /  0,  and  so  we  need  not  assume  it  explicitly. 
Now  suppose  we  are  given  equations  (5.1),  (5.2);  restraints 

(5.7)  ?(e)[T(e)  -  x(T+e)]  <  o,  e  e  [-h,o], 


(5.8)  [x(T+e)]2  -  [£(e)]2  <  o,  e  e  [-h,o], 


where      f  6  C([-h;0],R  "  ),    £  /  0,    and   (5«M J    and   cost   function  (5-5).      Augment- 
ing the   system  as  before,    we  obtain  a   special  case   of  problem  ^+.3,    with 

/E   o\ 

£  =  (£,0),  W  =(       J,  and  LQ(xt  ,*T_^T)  =  g(x    T)  +  xn(T).  Assume  the 

condition  given   before  theorem  5.1. 


Theorem  5.2.   Given  the  assumptions  above  and   u  e  0,     with  response  z 


92 


satisfying  the  necessary  conditions  of  theorem  h.y,    then  if  a°  f   0,  u  is 
an  optimal  control. 

Proof:   Let  Y  be  as  in  theorem  5.1,  x  the  response  to  a  control  v  e  fi 

such  that  Wxm  .  _  =  £  -   Wz.  ,  m.   Assume  a  -  -1.   Then  for  ty  given  by 
T-h,T    b     T-h,T  J 

(^-•35),  from  (k.$8)   we  have,  as  in  the  proof  of  theorem  5.1, 


(5.9)  Ks)-/  d[\|/(a)]n(a,s)  +  /  ^(a)T](a_,s)da 


0+  0+ 

-[/  d  A,  (0)  +  (O.'-^O,1)]  +  /  £(0)dX(0),   T-h  <  s  <  T, 
s-T  s-T 

0+  '       0+ 

-[/  d0X.o(0)  +  (0,...,6,l)]  +  /   £(0)d\(0),   t  <  s  <  T-h. 
-h  -h 


Again,    \|/   (s)    =  -1.      We   also   note  that 


T  0+ 

/     d   {/      S(0)d\(0)}[x(s)-Z(s)] 

T-h        s-T 

T  0+ 

=  /     dg{/      5(0)d\(0)}W[x(s)-z(s)]    =  0. 

T-h        s-T 


Using  this  in  place  of  J^   nQfLL.(xm  ,  m-zm  ,  _)  =0,  we  obtain  as  in  theorem 
5.1, 

n,.     n, 


0  =  -(-dg[  Vh,rXT-h,T-ZT-h,T]  "  [x  ^    "  Z  (T>]} 


-  /  {fn(x(s),s)-fn(z(s),s)-  ^(z(s),s)[x(s)-z(s)]}ds 


X0 


T 
+  /  Ks)[k(v(-),s)  -  k(u(-),s)]ds. 

*0 
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J(u)-J(v)  -  -{g(^.h^T)-g(zT_h^)-dg[zT_^TJXT_^T-zT^T]} 


-  /  {fn(^(s),s)-fn(z(s),s)-  ^L(z(s),s)[*(s)-z(s)]}ds 

t0  ax  ■ 

T 
+  /  t(s)[k(v(-),s)-k(u(-),s)]ds  . 

*0 


By  the  convexity  of  g,    convexity  of  f  («,s)   for  each  s  e  [t  ,T],  and  the 
assumption  that  u  satisfies  the  maximum  condition,  J(u)  -  J(v)  <  0.   Thus 
u  is  an  optimal  control. 


We  now  give  conditions  for  an  "attainable  set"  to  be  compact.  Let 
(S,  p)  and  (X,  d)  be  metric  spaces,  ^'(X)  be  the  collection  of  closed  sub- 
sets of  X.   For  a  set  A  C  X,  define 

J  [A]  =  [x  £   X:  there  exists  y  e  A  such  that  d(x,y)  <S}. 

I 

Definition  5°1°   The  mapping  FS  S  -> Sf(X)      is  said  to  be  upper  semicontinuous 

(abbreviated  u.s.Co)  at  t   e  S  if  lim  sup  F(t)  <  F(t  ),  where  supremums 

t  ->tQ 

are  taken  in     .Sf(X)      ordered  by   set   inclusion. 

Definition  5°2»      The  mapping     Fl    S  ->  i^(X)      is   said  to  be   upper   semicontinuous 
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with  respect  to  inclusion  (abbreviated  u.s.c.i.)  at   t   e  S   if  for  each  6  >  0 
there  exists  a  5  >  0   so  that  p(t,t  )  <  5  implies  F(t)  C  J  [F(t  )]« 
We  consider  the  system  of  equations 


(5.10)  f!_[D(x(.),t)]  =  f(u,x(-),t), 


(5»11)     x   =  cp  e  f,   y     a  compact  set  in  C([a  ,t  ]  ,Rn), 
t0  0  0' 


under  the  following  assumptions » 
(5.12)  Conditions  (2.5)-(2.5)  and  (3.1)  hold. 


(5.13)    The  mapping  Us  [t  ,T]  -*  isf(Rr)\{0}    is  u.s.c.  on  [t  ,1],   T  a 
given  constant,  T  >  t  . 


(5«  1*0    f *  M  X  C([a  ,T],Rn)  X  [t  ,T]  -^Rn  is  such  that  (u,V,t)  -> 

f(u,i|>(  °)  ,t)      is   continuous   in     (u/-|/)      for  fixed     t   e  [tQ,T]      and 

measurable  in     t     for   fixed      (u,ty)    e  M  X  C([an,T],R  ),   where 

M  =  U        U(t). 

t€[t0,T] 

(5-15)    There  is  an  integrable  function  AS  [t  ,T]  -»  R,  A  >  0,  such  that  if 
(Mpt),  (u,+2,t)  £  M  X  C([ao;T],Rn)  X  [tQ,T],   then 

[tiu^^-) ,t)-f{u,y2{>) ,t)\  <  A(t)iu1-'yt. 

(5ol6)  For  all     u  e  U(t),    \f(\i,V(>),t)\    <  v(t)[B   +  \\M\th   where     v      is 
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integrable  on  [t  ,T]   and  B  is  a  positive  constant, 


(5°  17)    TT  is  a  non-empty,  closed  subset  of  [t  ,T] 


(5.18)    S)(lJ,7r)  =  {(u,t  )S  t   e  it,    uS  [t  ,t  ]  ->  Rr,  u  measurable,  u(t)  €  u(t) 
a.e0  on  [t  ,t  ]}. 


(5ol9)    The  set  f(u(  t) , i<(  • ) ,  t)   is  a  closed,  convex  subset  of  R   for  each 
fixed   (i|/,t)  E  C([a0,T],Rn)  X  [tQ,T]. 


(5.20)    The  set-valued  mapping   \j/  e  C([a  ,t],R  )  -»  f(U(t),\J/(  Q),t)   is  u.s.c, 
for  each  fixed  t  6  [t  ,T]« 


The  conditions  (5» 12) -(5« l8)  are  sufficient  to  guarantee  that,  corresponding 
to  each  cp  e  f  and   (u,t  )  e  fi(U,7r),  there  is  a  unique  continuous  function 
(response),  x(°5cp,u)°  [o^,t,]  ->  R  ,  satisfying  (5«10)  a.e.  on  [t  ,t  ]   and 
satisfying  (5.11).   Let  h  >0  be  fixed* 

Definition  5°3°  A  point   £  e  C([-h,0],R  )   is  said  to  be  attainable  if  there 

are  a  cp  e  Y  and  a  (u,t  )  e  n(U,7r)   such  that  the  corresponding  response 

x(»3cp,u)   satisfies  x       (»jcp,u)  =  £.   The  attainable  set  &    is  defined 

t-^-h,t^ 

by   @   =  {£  e  C([-h,0],Rn)s  £   is  attainable). 

Theorem  5<Q.   If  the  system  (5.10)  with  initial  condition  (5. 11)  satisfies 
(5«l2)-(5-20),  then  ^  is  compact. 

Proofs  Vie  first  show  &£    is  conditionally  compact.  Without  loss  of  generality, 
assume  T  e  jfa      Let  (v*,T)  e  -Q(U,Tf),  and  for  any  (v,t)  e  fi(U,ir)   define 
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l    V(t)  if       t       <  t    <    T, 

v(t)  *  °-    ." 

«  v*(t)  if     t  <  t  <  T. 


Then      (vf,T)    €  fi(U,7r).      From  (5-10)    and   (5»l6), 


|~D(x(-5cp,v*),t)|    <v(t)[B  +  ||x(M9,v«)||t] 


Choose      y>0      such  that     0  <  6(  y)    <  lj    let     b   =  [l-S(y)]      «      Then,    for     t   € 

[t0,t0+r], 


and   so 


x('59,v«)llt  <  ||9||    +  25(T-a  )||cp||_+  5(r)||x(-3cp,v')||t 


t 
+  /  v(s)[B  +  ||x(.;cp,v»)||  _]ds, 

t 
x(*5<P,v')llt  <b[l+25(T-a0)]||q)||    +  b/  v(s)[B+||x(-5cp,v'  )||s]dB, 

t0 


B+||x(.5cp,v»)||t  <b[l+25(T-a0)][B+||cp||]    +  b/  v(  s)[B+||x(  .5cp,v»  )||  Jds, 


o 


By  Gronwall*  s  inequality,    on     [t    ,t ~+Y]  > 


B+||x(»$cp,v')||      <b[l+26(T-an)][B+||cp||]exp{b/  v(s)ds} 


In  a  similar  manner   on     [t0+y,    t   +2y], 
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B+||x(-5cp/v')llt  <  b[l+25(T-o;0)][B+||x(o5q),v»)|lt   +  Jexp{b/        v(s)ds) 

0       .     Vr 

<b  [l+28(T-a0)}   [B+||cp||]exp{b/   v(s)ds}0 

*o  ' 

T-t 

By  a  natural  induction,    if     n      =   1  +  greatest   integer   in     [ J, 

n0  n0  T 

(5-21)      B+!|x(-5cp,v»)!lT  <b  U[l+25(T-a0)]    U[B+B^]exp{b/   v(s)ds}    =  K, 

t0 


wh 


ere  B   is  a  bound  on  the  compact  set  Y«  We  define  \|/(  <»  ;cp,v,t)  %    [t  ,T]  -» 


R   oy 


(5.22)     Ht;q>,v,T)  =  f(v'(t),x(.;cp,v'),t),  for  cp  €  ?,  (v,t)  s  aCU,^) 


From  (5.l6)  and  (5.21),  for  all  t  z   [t  ,T],  cp  e  Y,  and  (v,t)  e  fl(U/ir), 


(5.25)  l*(t;cp,v,T)|   <  Kv(t) 


Since      f(  v*  (t)  ,x( "  jcp^v^t)      is  measurable   in     t,   the     1K°3cP>vjt)      are  measurable, 
and   thus  by  (5.23)    integrable   over     [t    ,T].      By  (5*10),    (5-11),    (5.22),    aad 
(5.25),    x(-jcp,vf)    €  C([a   ,T],X)Y  K  ,    (see     definition  3. 1) ,   where     X     is  the 
compact  ball  in     R       of  radius     K»      By  lemma  3«1,    C([ar^T],X)  is   compact 

in     C([an^T],Rn)  o      Thus,   by  the  Arzela-Ascoli  theorem,    the     x(o°cp,v' )      are 

uniformly  equicontinuous   on     [(XyT].      This   implies  that 


9      =     (XT-h,T("C^V,)°    9     "    ^>     (V>':)      6    °CU*Tr)} 


is  an  equicontinuous  subset  of  C([ -h,0] ,Rn) ,  is  bounded  by  K,  and  hence  is 
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conditionally  compact „ 

We  now  show  &   is  closed..   Let  ^xt^ott-xt00  •   ^e  a  sequence  of 
points  in  &    such  that  L    -»  £_   as  k  ->■»«,   By  the  definition  of  ^,  there 
exists  a.  sequence   (p   e  I;  k  =  l,2,3,oco,   and  a  sequence  (u,,t  )  c  Q{\J}ir)} 

K  K   k 

k  =  l,2;3;oo.;   such  that 


(5.2>0  x      (-5VV  '  ^"^0  *s  k— ■ 

k  '  k 

T  T 

Let  \|/  =  ^('jcp wu,_,t  )»   By  (5»23),  /  |\J/  (t)ldt  <  /  Kv(t)dt,  so  as  elements 

1  0  0 

of  L  [t  ,T]   the  functions  \|/   form  a  hounded  sequence..   By  (5«23)  and 

[8;  corollary  IV. 8. 11]  the  set   {\J/  s  k  =  1,2,0<>o)   is  weakly  sequentially  cora- 
ls 

pact  in  L^t  ,T].   Hence  there  is  a  subsequence  (still  denoted  by  \|/,  )  which 

1_ 

converges  weakly  in  L  [t    ,T]      to  an  integrable   function     \|/   t    such  that 

cp.    ->  cp*   c  If     as     k  -»  co,    and     t     -»  t*   e  tt     as     k  -»  °°«      Thus,    for  each  measurable 

K  K 

EC  [t  ,TJ, 


lim  /  *,(t)dt  =  /  Vn(t)dt. 
k  ->«  E  K       E  ° 

Since  the  x( » ;;cp ,  ,u! )   are  contained  in  the  compact  set  C([a  ,T]  ,X)W       ,  there 

K.   K.  U         x  •  Jtv  "^ 

exists  a  further   subsequence      (still  denoted     x(  °  ;cp,  ,u* ))    and   a   function 
y  e  C([aQ,T],X)Y  Kv      such  that     ||x(  ^cp^u^) -y[|    ->  0     as     k  ->  ».      Hence, 
uniformly  in     t   £   [t    ,T]? 


lim     /  d0[pi(t,0)]x(0;cpk,u«c)    =  /  de[u(t,e)]y(9) 
k  ->  oo  aQ  aQ 


Define  the  function  zs  [a  ,T]  -»  R   by 
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z       =  cp*, 

0 

z(t)    =  D(cp*,t   )    +  /  d0[n(t,e)]y(0)    +  /   *  (s)ds,      t     <  t  <  To 
Using  (5-10),    (5-11),    a  ad    (5«22)    we   have,    for     t    e   [t„,T],      lim  x(t;cp      u') 


z(t)o.    Thus      z   =y,    and 


(5.25)  |iX(-cpk,u^)-z||T  ->0      as      k^oo, 


(5.26)  z       =  cp*, 

^0 


t  t 


z(t)    =  D(«p*,t   )    +  /  d0[u(t;0)]z(9)    +  /   <r  ( s)ds,      t     <  t  <  T. 


We  now  show  that,    as      k  -» oo,    [see   (5. 2k)] 


(5-27^  Vh,tv(o5CPk^k)    =  Xtv-h;t^\'V    -V-h,t*   =   V 

k     '   k  k     '    k  ' 

Define      x   (t    ,s)    =  min{t   ,t,+s),    x   (t    ,s)    =  max(t    ,t   +s}.      For  the      s   e  [-h,0] 
such  that     t*+s  <  t    , 


x(tk+s5cpk,uy    -   z(t*+s)|    <  |x(tk+s5cpk,uk)    -  cpk(t*+s) 


+  |cpk(t*+s)    -  cp*(t*+s)| 
<  |x(x+(tk,s)5cpk,uk)    -  cpk(t0)| 

+  J<Pk(T"(tk,8»     -    Cpk(t*+S)| 

+  |cp   (t*+s)    -  cp*(t*+s)j  . 
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Since  t  ->  t*  as   k  -»  «>,  t  (t  ,  s)  ->  t   uniformly  in  s   as   k  ->  »,  so  by 

the  equicontinuity  of  C(  [QL.,T]  ,X)  w     the  first  terra  goes  to  zero  uniformly 

0       i  jKV 

in   s   as   k  ->  =»<.   By  the  uniform  equicontinuity  of  Y,  the  second  term  goes 
to  zero  uniformly  in  s  as  k  -»  •»„   Since  j|cp ,-<P'x||  ->  0  as  k  ->  <»,  the  third 

term  goes  to  zero  uniformly  in  s  as  t  -»  <»0   for  the  s  e   [-h,0]   such  that 
t*+s  >  tQ, 


|x(tk+s;cpk,uk)-z(t*+s)|  <  |x(tk+s?cpk,up-x(t*+s5cpk,u^) 

+  |x(t*+sj<pk,u^)-z(t*+s)| 

<  I  ^Pk(^'(tk,s))  -cpk(tQ)i 


+  [  g(x(  •  }cpk,  uj,) ,  t+(  tk,  s) )  -g(x(  .  ;cpk,  uR) ,  t*+s) 

T+(t  .,8) 

+  |/    K   Kv(a)d6| 
t*+s 


+  |x(t*+s59  ,u»)-z(t*+s)|  . 


By  the  equicontinuity  of  Y  and   t  ->  t*  as   k  -*  <*>,  the  first  term  goes  to 
zero  uniformly  in  s  as  k  ->  coa   By  C([OL,T],X)™  „  X  [t  ,T]   compact  and 
the  joint  continuity  of  g  [see  (204)]_,  since  t,  -» t*  as  k  -»  oo  the  second 
term  goes  to  zero  uniformly  in  s  as  k  -*  co0   Since  /  Kv(0)d8  is  absolutely 
continuous  and  t  -*  t*  as  k  -*  <*>,   the  third  term  goes  to  zero  uniformly 
in  s  as  k  -»  <»„   By  (5»25)  the  last  term  goes  to  zero  uniformly  in  s  as 
k  ->  oo0   Thus  we  have  shown  that  (5°27)  holds. 

The  proof  that  &     is  closed  will  be  complete  if  we  show  there  is  a 
u„   such  that  (u  ,t»)  e  fi(U,7r)   and 
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(5.28)  x(t;q>*,u0)  =  z(t),  tQ  <  t  <  t*. 

(Except  for  notation,  the  remainder  of  the  proof  is  almost  identical  to  that 

of  Jacobs  [18],  theorem  k.l,    following  his  equation  (4, 10).   It  is  included 

here  for  completeness.)   The  subsequences   [\(i  ,  k  >N),  K  =  1,2,5,...,   also 

converge  weakly  to  \|/  .   Corresponding  to  each  sequence  (^vy   k  >  N},  there 

is  a  sequence   f^'f,T)   of  convex  linear  combinations  of  the  U<   k  >  N,  such 
kN  k'   —     ' 

that  each   C^vm?   converges  to  \|/   in  L  -norm  (strongly)  [8  I  corollary 

Ki\  (J 

V.5.1^].      The   sequences      (^i*^},    ^   ~   ^->^>3>  •••>      also  converge  to     \|/        in 
measure   [85    theorem  III. 5. 6],      Thus,    for   each     N   =   1,2,5,...,      there   is   a 
subsequence   of     C^TO3      (still  denoted      [\|/*   }).such  that      C^*-)      converges 
pointwise  to     \|/        a.e.    on     [t   ,  T],    N   =   1,2,5, ...    .      Let     E       denote  the   sub- 
set  of     ft    ,T]      on  which      f^*}      does   not  converge  pointwise  to     \j/  > 
l    q)    j  LYkNJ  &     r  0 

00 

N  =  1,2,5,...  .   Then  the  set  E   =  U   E   has  Lebesgue  measure  zero.   Let 

t  e  [t  ,T]\E   be  fixed.   Let  B   be  a  ball  in  C([a  , t],Rn)   which  is  large 

enough  that  x(.jcpk,uj^)  e  B  ,  k  =  1,2,5,...   [see  (5.21)].   Then,  by  (5.l6), 

(5.20),  and  [185  theorem  2.U],  the  mapping  x  e  B  -*  f(U(  t)  ,x(  ° )  ,t)   is 

u.  s.c.i.   Thus,  given  S  >  0,  there  is  a   o  >  0   such  that  x  e  B   and 

||x-z||t  <  o£   imply  f(u(t),x(  •)  ,t)  C  Jg[f(u(t),z(  >),t)].      By  (5-25)  there  is  a 

positive  integer  NR   such  that  k  >  N~   implies  ||  x(  °  jcp  ,u' ) -z||   <  %° 

o  —  o  k  k    t    G 

Thus,  when  k  >  N&  ,  f(U(  t)  ,x( « ;cpk,  uR)  ,t)  C  J£[f(u(t)  ,z(  •)  ,t)  ].   Since 
*k(t)  e  f(u(t),x(  =  3cpk,uk),t),  k  =  1,2,5,...,   and  since  Jg[f(U(t)  ,z{ ')  ,t)] 

is  convex  [see  (5-19)1,  it  follows  that   (\|/*   (t))  C  j  [  f(u(t)  ,z(  • )  ,t)  ] . 

5 

g 

Consequently,  tyA(t)   belongs  to  the  closure  of  J  [ f(U(t) ,z( O ,t) ] .   Since 
0  t 

£  >0  was  arbitrary,  we  must  have  ^n(t)  £  f(TJ(t)  ,z(  • ) ,  t) .   Thus  ^n(s)  £ 
f(U(s),z('),s)   a.e.  on  [t  ,T].   By  (5-13)  and  [18;  theorem  3.1],  there  is  a 
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measurable  function  u  .  [t  ,t*]  -» R  such  that  u  (t)  e  U(t),  t  <  t  <  t*, 
and  ii'Q(t)  =  f(uQ(t),z(°)  ,t)  a.e.  on  [t  ,t*-].  Using  (5.26),  we  have  that 
(5c 28)  holds. 

Since  we  have  shown  &    to  be  conditionally  compact  and  closed,  the 
proof  is  complete. 

Let  (S,p)   be  a  locally  compact  metric  space,  (X,d)   a  metric 
space.   The  following  more  general  statement  of  [185  theorem  2.2]  is  also  a 
special  case  of  results  in  [17  °}    chapter  2]  „ 

Lemma  5«1«   Given  a  mapping  Y%    S  ->.£f(X),  the  following  are  equivalents 


"0  *  °> 

ii)   if  (t  },  (P  )   are  sequences  in  S  and  X  respectively  such 

that  P  e  F(t  ),  n  =  1,2,3,...,   and  t  -»  t^,  P  ->  P^  as  n  ->  co   then 
n    v  ny '      '  '  '    '        n    0'   n    0 

P0  e  F(t0). 

Let  there  be  given  a  mapping  JT  -  [t  ,T]  ->  5f(C(  -h,0]  ,P.n)  )\{0) 
which  is  u.s.c.  on  [t  ,T].   Define 


&   =  txt  -h  t  (0^^u)  e-^°*t  _h  t  (S<P,u)  s  -^"(t1)}3 

Theorem  5=^-«      Given  (5»  10)  -(5-20) ,  ^   as   above,    and   a  continuous   function 

n  "s 

p!    C([-h,0],R   )    ->  R$    then  if     ^     is   nonempty  there   exists      (cp*,u*,t*)    e 

Sf  X  fi(U,7r)      such  that     x  t*( ° 59** u*)    €   ^     and 


P(xt#-h,t*("5<P*'U*^    =min[p(0  8    £    £    ^} 


Proof 8   By  theorem  p. 3  and  lemma  5«1,  &     is  closed,  and  hence  by  theorem  5»3 
is  compact.   This  and  p  continuous  imply  the  result. 
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^*   Partial  Differential  Equations  and  Examples 

The  theory  above  may  be  applied  to  certain  linear  hyperbolic  partial 
differential  equations  with  boundary  controls.   For  this  discussion,  subscript 
t  or  x  denotes  the  respective  partial  derivative,  and  prime  denotes  the 
total  derivative.   Suppose  we  are  given  the  equation 


(6.1)  \t(t>x)  *  c2wxx(t'x)  =  °>   t  C  [0>ro)'   X  €  [0>1]> 


with  initial  conditions 


(6.2)  w(0,x)  =  fQ(x),   wt(0,x)  =  f^x)   on  [0,1], 

and  the  boundary  conditions 

(6.3)  AQ(t)wtt(t,0)  +  BQ(t)wtx(t,0)  =  GQ(t,w(t,0),wt(t,0),Wx(t,0)), 
A1(t)wtt(t,l)  +  B1(t)vtx(t,l)  =  G1(t,w(t,l),wt(w,l),wx(t,l)), 

where  the  initial  functions  satisfy  the  boundary  conditions  at  t  =  0. 
This  is  a  controlled  system  if 

Gx(t,p,a,T)  =  F1(t,v(t),p,a,T), 
and  (y)   is  the  control.   We  make  the  following  assumptions: 


10  Jl- 


(6.4)        ^A(x)      an^      ^-|(x)      are  absolutely  continuous,   with  derivatives   in 
L  [0,1]    . 


(6.5)      The     A.      and     B.      are   continuous,    the      G.      are  measurable   in     t     and 
v        ' ,  l  l  '  l 

continuous   in     (w,v,  ,w  ),    and   for  each  compact     Z  C  R       there   exists 

2 
K.    6   L        ([0,°°), R)      such  that      |G.(s,y)|    <K.(s)      for   every     s   €   [0,°°) 

and     y  e  Z,    i   =  0,1. 
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(6.6)      For  each  s  e  [0,«>), 


[Ao(s)  "  i  Bo(s)]  ^  °'  [Ai(s)  +  iBi(s)]  *  °' 


Motivated  "by  partial  differential  equations  and  the  paper  by  Cooke 
and  Krumme  [7]j  we  assume  a  solution  of  the  form 

(6.7)  w(t,x)  =  cp(t  +  £)  +  ^(t  -  5. 


Substituting  this   into  (6.3),    and   setting 


a.(s)    =  [A.(s)    +  h±(s)],    p.(s)    =  [A.(s)    -  ^(s)],    i    =  0,1, 


we   obtain 


(6.8)  QL(t)cpM(t)    +  Pn(t)V*(t)    =  G  (t,f  (0)    +  /  cp'(s)ds   +  /   *«(s)ds, 

u  u  u  u  0  0 


cp'(t)   +  r(t),  ip'(t)   -  i|r»(t)) 
=  ^fo'COi+'CO**),      0  <  t, 


and 


a 


(t  -i)cp"(t)    +p  (t  -§)V(t  -§) 


t  t-2 


=  Ga(t   -  ~,f0(0)    +  /  cp'(s)ds  +  /       V(s)ds, 


0 


q)t(t)    +  *«(t   -  §),   |p'(t)-i|r«(t  -|)) 


£.,_(¥•(•), v (•),*),   |<t. 


By  (6.6)  it  is  proper  to  multiply  this  pair  of  equations  by  the  matrix 
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0 


a,(t  -  -) 
lv  cJ 


W> 


«0(t) 


«,.(t  -  |)P0(t) 


we  then  obtain 


(6.9) 


q>"(t) 


r(t) 


QL(t    -   -) 
lx  CT 


«n(t)Pi(t    -  7) 


**"'  x       c'  ♦B(t-9J 


«x(t  -  i)p0(t) 


al(t  "  c} 


r  G^cp'CO, *'(•),*) 


^y   G0(cp»(.)^'(-),t)    - 


a0(t) 


a,(t  -  i)p  (t) 


&!(?' (•),**(•),*) 


for     t   >  -  . 
—  c 


From  (6.2)    and   (6.7),    for     x  €   [0,1], 


ip'(?)  ->(-£)  ■  fA(*), 


c     vc  .     c 


<P'(f)    +  f(-f)    ■   f^*), 


107 


Thus,    for     x    €   [0,1], 

«p'(f)  -|f0W  +  |VX>> 

(6eii)  implies  that  cp1   on  [0,  — ]   and  V'   on  [  -  — ,0]   are  determined  as 

p 
absolutely  continuous  functions  with  L   derivatives.  We  use  (6.8)  to  deter- 
mine \|/'   on  [0,  —  ] ',   by  (6.5),  {&•&),    and  (6.8),  \|/f   is  absolutely  continuous 

1-,  2 

on  [0,  —J   with  an  L   derivative.   Thus  there  is  sufficient  initial  data 
L  '    c 

to  solve  (6. Q),  with  OL  =  ,  t_  =  —5  theorem  2.1  guarantees  the  existence 

\        y  j )  q       C0C 

of  a  continuous  solution  (cp',^').   From  (6.5)  and  (6.9)  we  see  that  the  solu- 

2         2 
tion  is  absolutely  continuous,  with  a  derivative  in  L,   ([0,°°),R  ).   By 

construction,  w(t,x)   given  by  (6.7)  satisfies  (6.2)  and  (6.3).   The  derivatives 

of  w(t,x)   through  second  order  obtained  by  formally  differentiating  (6.7) 

are  derivatives  of  w(t,x)   in  the  ordinary  and  generalized  sense  (the  latter 

from  an  integration  by  parts).   Thus  w  may  be  said  to  solve  (6.1)  in 

either  the  generalized  sense  or  in  the  sense  of  almost  everywhere  (which  does 

not  seem  to  be  well-established  in  partial  differential  equations). 

If  we  are  given  the  terminal  conditions 


w(T,x)  =  gQ(x),  wt(T,x)  =  g]_(x)   on  [0,1], 


where     g  ,    g        satisfy  (6.k) ,   we   obtain,    for     x   e   [0,1] 


"(T  +£)    =f  gj>(*)    +K(X>> 


*'(T  -  f)    =  "  fsj(x)    +  pgl(x)^ 
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exactly  as  for  the  initial  conditions.   These  give  terminal  conditions  as 
a  target  function  for  ty1   on   [T ,T]   and  for  cp1   on  [T,T  +  — ] . 

Remark  6. 1.   The  form  of  the  equation  and  terminal  conditions  above  shows  that 
it  is  reasonable  to  require  that  terminal  conditions  be  given  on  [T-h,T]   even 
when  the  hereditary  dependence  of  the  neutral  equation  is  truly  of  the  (x( '),t) 
form. 

Remark  6.2,   Instead  of  the  equation  (6.1)^  suppose  we  have  the  coupled  equa- 
tions 


Lit  =  "V 


Cv,  =  -i  , 
t     x' 


with  initial  conditions 


i(0,x)  =  i(x),  v(0,x)  =  v(x),  x  e  [0,1], 

and  boundary  conditions 

AQ(t)it(t,0)  +  BQ(t)vt(t,0)  =  gD(t,i(t,0),v(t,0)), 
A1(t)it(t,l)  +  Bx(t)vt(t,l)  =  gl(t,i(t,l),v(t,l)). 

Let      i     and     v     be  absolutely  continuous,   with  derivatives   in     L  [0,l]j    the     A., 
B.      and      g.      satisfy  conditions    similar  to  (6.5)    and   (6.6). 
Assume   a   solution  of  the   form 
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r(t,x)    =  — jr{*(t    -   xv/lC)    -  cp(t    +  x  n/lC )  ] , 
2n/C 


i(t,x)    =  — ±_[i|r(t   -   x/lC)    +  cp(t   +  xn^LC)] 
2n/l 


As  above,  we  obtain  an  equation  of  neutral  type  in  \J/  and  cp,  whose  solution 

2 
will  be  absolutely  continuous  with  locally  L   derivative.   This  yields  a 

2  4 

pair  (i,v),  with  (\>\>vt'Vx)    £   Lloc^0'°°)  X  ^°->1^R  ^  which  satisfies  the 

coupled  equations  in  the  generalized  sense. 

Remark  6.$.   It  is  not  always  necessary  to  have  conditions  (6.6)  hold.   For 
example,  assume 


AQ(s)  =  BQ(s)  =  0,      [Ax(s)  +  ^(s)]  f   0   for  all  s  >  0. 

If  the  boundary  condition  at  x  =  0  can  be  used  to  solve  for  Y      as  a  func- 
tion of  cp'j  we  substitute  this  into  the  boundary  condition  at  x  =  1  and 
obtain  an  equation  of  neutral  type  in  cpf   alone.   The  equation  may  then  be 
converted  to  an  equation  in  either  w   or  w  .   This  procedure,  in  connection 
with  the  coupled  equation  mentioned  in  remark  6.2^  was  used  by  Brayton  [5, 
section  2]. 


Example  6.1.   Consider  the  transmission  line  given  by 


I 


x=0 


4      l(t,x) 
v(t,x) 


-^I3» 
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where  E   =  200v,  R   =  ^OOft,  L  =  lh,  |E  |  <  75v,  C  =  10 "  f,  and   L  =  0.l6h 
(these  last  two  values  correspond  to  a  transmission  line  roughly  10   meters 
long) .   The  equations  are 


0.l6it(t,x)  =  -vx(t,x), 
10'  v,(t,x)  =  -i  (t,x), 


with  boundary  conditions 


0  =  200  -  v(t,0), 

it(t,l)  =  v(t,l)  -  lKX)i(t,l)  -  E^t). 

If  we  assume  a  solution  as  in  remark  6.2,  we  obtain  the  equations 


\Jf(t)  =  cp(t)  +  0.4,   t  >  0, 
(6.10)       4''(t)  +  \|/«(t-h)  =  -800i|r(t)  -  0.8E  (t  -  |)  +  320,  t  >  |, 


where  h  =  2  v LC  =  8  X  10   sec.   By  a  different  sequence  of  substitutions 
(similar  to  those  detailed  in  Slemrod  [25])  we  obtain  the  equation 


^-[i(t.i)  +  i(t-h,l)]  =  -800i(t,l)  -  Ex(t)  -  E  (t-h)  +  kOO ,    t  >  h. 


If  the  control  is  the  value  of  E  ,    these  are  equations  of  neutral  type  with 
delays  in  the  control. 

Suppose  we  are  given  initial  conditions  i(0;x)  h  0,  v(0;x)  =  200; 


Ill 


thei 


n  on  [-  |,0],  *(s)  s  0.2,  on  [0,  |],  <p(s)  =  -0.2.   Thus  we  may  take  (6.10) 


h  /  \      o      r   ^   ^1 

as  the  equation  for  t  >  ^  with  initial  function  \|j(s)  =  0.2,  s  €  [  -  75,  ^J. 

To  obtain  an  initial  function  for  the  equation  in  i,  one  must  use  another 

equation  such  as  (6.10),  and  the  initial  function  i(s,l),  s  e  [0,h],  will 

depend  on  values  of  E^s)   for  s  6  [0,h]„ 

Attempts  were  made  to  determine  the  values  of  E  (t)   (acting  as  a 

control  variable)  which  would  drive  i  „  ,  .„(».l)   to  the  constant  function 
'  t"-"-n,  t*v  '  ' 

£(9)  =  0.4,  6   e   [~h,0],  in  minimum  time  t*.   The  problem  of  hitting  i(t*,  1)  = 
0.4  in  minimum  time  was  solved,  but  the  trajectory  could  not  be  held  at 
i(s, l)  =0.4  for  s  e  (t*,t*+h].   Despite  repeated  efforts,  a  solution  was 
not  obtained  for  the  problem  with  a  function  target. 

We  now  consider  a  less  complicated  version  of  problem  4.3,  and  the 
corresponding  statement  of  theorem  4.3.   Assume  the  equation  has  the  form 

x(t)  +  Ax(t-h)  =  Bx(t)  +  Cx(t-h)  +  k(u(-),t) 

in  R   ,  with  fixed  initial  function  x  .  We  wish  to  drive  to  the  piecewise 

C   function  £:  [-h,0]  ->  E   ,  £  p  0,  in  a  manner  such  that  the  function 

T 
J(u)  =  /  f(x(  s),u(  s),  s)ds  is  minimized  over  a  given  class  of  controls,  0.. 

0 
Assume  that   {f(x(t),u(t), t) :  u  €  fi}   and   (k(u(*),t):  u  €  0,}    are   quasiconvex 

families  of  functions  (for  example,  satisfy  the  conditions  of  lemma  3.3). 

Theorem  6. 1.   Given  the  assumptions  above,  let  u*  be  an  optimal  control  with 
response   z.   Then  there  exist  a  row  n-vector  valued  function  \J/  defined  on 
[O,00),  a  real- valued  function  X   =  2\  -\       defined  on  R,  and  a  real  number  a   , 
such  that 

i)  X.      is  a  non-increasing  function  of  bounded  variation,  continuous 
from  the  left,  A,.  =  o  on  (0,°°),  a.,   constant  on  (-°°, -h], 
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i   =   1, 2'}    a     <  0;    I  a  I    +     var     A,     + 


var     X,p  >  0. 


[-h,«,)  [-h,») 

ii)      \|f     is   given  by 

i|/(s)    =  0,      s  >  T, 

*(T)   =  (-5(o)x(o),a°), 

0+  /A     0 

\|/(s)    =  (/      £(e)cU(e),a°)    -  t(s+h) 

s-t  yo    0 

T  /c     0\  T  /       B  o\ 

+  /     iKa)  )  da  +  /  \|/(a)  da, 

s+h  \0     0/  s  V   df,    ,    x      „,    N      N     _/ 

\         /  \^(z(a).u*(a),a>)     0/ 

s   s  [0,T). 
iii)      the   following  maximum  condition  holds: 


T  /k(u(-),s)  \  T  /    k(u*('),s) 

/  i|/(s)  ds  <  /   i|/(s)  ]    ds 

0  \f(z(s),u(s),s)/  0  \f(z(s),u*(s),s) 


for  all     u  £  Q. 

Theorem  6.1  is  applicable  to  each  of  the  following  examples;  graphs 
of  the  corresponding  optimal  trajectories  and  optimal  controls  are  at  the  end 
of  the  chapter. 

Example  6.2.   Consider  the  equation 

x(t)  =  x(t-l)  +  u(t),   t  €  [o,T]; 


here 
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(  o,    t-i  <  0, 
n(t,e)  =  {  T)(t,e)  =  o. 

( -1,  e  <  t-i, 


Let  T  =  3,  initial  function  cp(0)  =  1,  0  €  [-1,0],  target  function   £(0)  =  1-0, 

T  2 
0  e  [-1,0],  and  cost  function  J( u)  =  /  u  (t)dt„  Augment  the  system  as  in  re- 

0 
mark  h. h'f    the  problem  is  now  in  the  form  of  problem  ^-.3.   The  adjoint  matrix 


is  given  by  Y12(s,t)  =  Y2JL(s,t)  =  0, 


!0,    t  <  s, 
K,    t-K  <  s  <  t+l-K,   k  =  1,2,3,..., 


(0,    t  <  s, 
Y22(s,t)  =  J 

(  1,    s  <  t. 


An  optimal  trajectory  arid   control  are 
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Z(t)    = 


1  +  -t,        t    e   [0,1], 

y  +  5*,        t    €   [1,2],  u*(t) 

4-t        ,        t    e   [2,3], 


2 

3' 

1 

y 

h 

y 


t  e  (0,1), 
t  6  (1,2), 
t   e   (2,3). 


Let     a    =  -1,      \(e) 


1 

8 

0, 


0  e  (-co,-i], 

9   e   (-1,0], 
0    6    (0,oo); 


(5,  -1),  s  e  (0,1), 
{  (-f,  -1),  s  e  (I,2), 
1     (4    -1),         s    e   (2,3). 


The   integral  maximum  condition  is   equivalent  to  the  point-wise  condition 


/v  \  /u*(s)   \ 

t(s)(      2)     <  t(s)  (       2         I     a.e.      on     (0,3), 


v 


for  all  v  e  R.   This  implies  2u*(s)  =  \|/  (s)„   Theorem  5«2  guarantees  that 
the  solution  given  is  optimal. 

Example  6.3.   Consider  the  same  problem  as  example  6.2,  with  the  added  restric- 
ts 
tion  that  |u(s)|  <  v-,  s  e  [0,3].   Then  an  optimal  trajectory  and  control  are 
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1  +  |t,   t  e  [0,1], 

{  |  +  ft,   t  e  [1,2], 

1^-t  ,  t  e  [2,3], 


u*(t)  = 


\>      t  6  (0,1), 
|,   t  e  (1,2), 

|,   t  €  (2,3). 


Let  a  =  -1,  X(6)    =   {   7j 


then     v(s)  = 


/    1              9 

e 

(-oo,-l], 

i    7 

2'           9 

e 

(-1,0], 

\  o,        e 

€ 

(o,-); 

(\,  -i), 

s    e   (0,1), 

(-1,-1), 

8    e   (1,2), 

(-P-1), 

s    e   (2,3). 

5  5 
The  maximum  condition  is  as  before,  except  that  only  v  e  [  -  -r}   -j-]   are  con- 
sidered. 

Exgjnple  6.k.      Consider  the  same  problem  as  example  6.2,  with  T  =  p.   Then  an 
optimal  trajectory  and  control  are 


Z(t)  = 


l.gt-. 

t    6    [0, 

|], 

£♦*' 

t   e   [|, 

1], 

30       15*' 

t    €    [1, 

&. 

1-     . 

t     6_[|, 

&. 

u*(t)  = 


16 

15  ' 

t 

*  (0,   g), 

1 

5     ' 

t 

*  (p    1), 

1 

3     ' 

t 

e  (1,  |), 

6 
5     ' 

t 

e  (|,    2), 

26 

15  ' 

t 

6  (2,   §). 
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Let  a  =  -1,   X(9)    = 


9   e  (--,-1], 

e  €  (-i,  -  |], 

0  e  (0,-); 


/  k15' 


•1) 


then  ty(s)  =  < 


(§,  -1)    , 
(-f,-l)   , 


s  e  (0,  g), 
s  e  (^  L)j 

S  6  (1,  |), 

?  e  (|,  2), 

s  e  (2,  I)- 


The  maximum  condition  is  as  in  example  6.2. 


Example  6.5.   Consider  the  same  problem  as  example  6,2,  except  that 


5(e)  = 


i 

2 


i* 


,   0  e  [-1,  -  i], 


e  [-  5,  0], 


Then  an  optimal  trajectory  and  control  are 
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z(t)   = 


1    -    -_   t,        t     €     [0,     p], 


\~t    ,        t  €    [^   ,  1]  , 

J2*     ,        t  €     [1,     |] 

t  6   [|,    2], 

t  e   [2,   |], 

t  6   [§,    5], 


u*(t)   ■= 


\ 


/■_ 

1 

12    » 

t 

€ 

(o, 

1), 

7   ■ 

12    » 

t 

6 

& 

1), 

1. 

1 

3     ' 

t 

€ 

(i, 

!)> 

1 
3'    ' 

t 

e 

(-!. 

2), 

- 

7 

12    ' 

t 

e 

(2, 

|, 

\  .   12"  ' 


t  e  (4  3). 


Let  a       =  -1,        X(6)    = 


0    6    (-00,-1], 

e   e   (-1,-  |], 


0   e   (-  |,0], 


0  e  (o,°°); 


then 


i(s)  = 


< 


Vp  -d, 


s  £  (o,  *), 


s  e    (^  ^J 

s  e   (\,  2), 

s  €    (2,  §), 

b  e  (§,  3). 


The  maximum  condition  is  as   in  example  6.2, 


Example  6.6.      Consider  the   equation 


here 


"(t)  =  x(t)  -  x(t-l)  +  u(t),    t  e  [0,T]; 
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u(t,0)  =  0,   r,(t.0)  = 


0,  .  t  <  e3 

-1,   t-i  <  0  <  t, 
0,   0  <  t-i. 


Let  T  =  2,  initial  function  cp(0)  =  0.  0  £  [-1,0].  target  function   £(0)  =  2+0, 

'T  2 
0  e  [-1,0],  and  cost  function  J(u)  =  /  u  (t)dt.   Augment  the  system  as  in 

0 

remark  h.k.      The  adjoint  matrix  is  given  by  Yip(s,t)  =2  Yp  (s,t)  =  0, 


Yxl(s,t)  =  J 


(t-s) 


,   t  <  s, 

,   t-1  <  S  <  t, 


Y0o(s,t)  = 


e(t-s)-(t-l-s)e(t_1"s)  ,   t-2  <  s  <  t-1, 


0  ,   t  <  s, 


"22 


1  ,   s  <  t. 


An  optimal  trajectory  and   control  are 


Z(t)    - 


,     sinh   (\T2  t)  t                     r/.    _- 

I     V    r     '  +  o   ,        t   e   [0,1], 

2   sintW2 

t  ,        t   €   [1,21. 
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u*(t)    = 


2   sinh  J~2 


-[^2  cosh  (\T2  t)    -   sinh(\f2  t)  ]    +  %=^-,     t   €  (0,1), 


( 


sinh  [J~2   (t-1)]  (1-t) 

r  +       2 

2   sinh  V2 


t    e   (1,2). 


Let     a°  =  -1,    tetd>.(t-2)    =  dp(t),    where 


[l-sf2  coth^e1, 


t     €     (-oo,l], 


P(t) 


sinh  s/2 


[exp{(V"2+l)t-/2)    -   exp{-(^2-l)t+/2}]    +  (t-l)et,    t€(l,2], 


then 


t    e   (2,oo). 


( — I [^2  cosh(\T2s)    -   sinh(>T2s)]    +  l-s,-l),        s   e  (0,1), 


sinh  v  2 


+(s)  = 


sinh  </~2 


,         s    e   (1,2). 


The  maximum  condition  is   as   in  example  6.2, 


Example  6.7.      Consider  the   same   problem  as   example  6.6,   with     T   =  3,    |u(s)j    <  1 

p  "~ 

for      s   e  [0,3],    and   cost   function     J(u)    =  /  x(t)dt.      We  do  not   have   to  augment 

0 
this  problemj    the   adjoint   function  is   given  by 
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Xt-s) 


Y(s,t)  = 


>   t  <  s, 

,  t-1  <  s  <  t, 

,  t-2  <  s  <  t-1, 


^-^-(t-l-s)^"1-*) 


An  optimal  trajectory  and  control  are 


l-e° 

2e     -e  -1 

zl^)  =  \  2ev    y-e  +(t-2)ev    ', 

0  (t-co)   t  t      ON  (t-1)  0/   0   v  (t-l-co) 
2ev    -e  +(t-2)ev    -2(t-2-o))ex     ' 

t-1 


-2 


t  £  [0,0)], 

t  e  [oo,l], 

t  e  [  1,1+cd], 

t  €  [1+03,2], 

t  e  [2,3]. 


u*(t)  = 


-1 


,  t  e  (0,0)), 
,  t  e  (o),2), 
,   t  €  (2,2+cd) 


2.t+(t-J)e(t-2)+2e(t-1-^-e(t-1) 


where  o)  is  the  solution  of  (e  +o))e^    '    =  ^[3+e  ],  and  is  given  approximately 
by  co  =  0.531,  e^1'^  =  1.599  . 


Let  a   =  -1,   \(6)  =■ 


-a 


e  (-00,-1], 


0    ,   9  e  (-I,-); 
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[a1-l][e^2"s)-(l-s)c^1"S)]-e(l"s)+2,    s  e  (0,1), 

Ks)  =|  [a~-l]e(2~S' +1  ,  '  s  e  (1,2), 

0  ,   s  €  (2,3). 

a   is  given  approximately  by  a     -   O.889.   The  maximum  condition  is  i|>(s)v  < 
ij/(s)u*(s)   a.e.  on  (0,3),  for  all  v  e  [-1,1], 

Remark  o.k.      Example  6.2  was  first  solved  for  the  equivalent  problem  of  driv- 
ing to  the  point  x(2)  =2  with  the  cost  function 

2  2 

p  .     ? 

J(u)  =  /  u~(t)dt  +  /  [l+x(t)]  dt  - 
0  1 

2  2 

=  2/  {u  (t)+u(t)}dt  +  2/  u(t-l)u(t)dt+l 

0  1 

1  2 

=  /  x2(t)dt  +  /  {[x(t)-x(t-l)]2  +  [i+x(t)]2}dt, 
0  1 

using  theorems  k.2   and  5.1  and  the  information  from  the  Euler  equation  (see 
El*  sgol*  c  [9,  p.  220])  that  extremals  consist  of  straight  line  segments.   This 
equivalent  problem  also  satisfies  the  sufficient  condition  of  Hughes  [l6, 
section  3].   Knowing  the  solution  to  example  6.2,  example  6„3  was  worked  di- 
rectly with  the  action  of  the  restraint  and  theorems  ^.3  and  5.2.   Examples  6.k 
and  6.5  were  solved  by  theorems  k.3   and  5.2  with  the  assumption  that  the 
optimal  trajectory  would  consist  of  straight  line  segments.   Example  6.6   was 
solved  in  the  equivalent  form  of  driving  to  the  point  x(l)  =1  with  thQ 
cost  function 
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J(u)  =  /  (u2(t)  +  [x(t)~t]2}dt 
0 

t_ 

=  A[x(t)-x(t)]2  +  [x(t)-t]2}dt, 
0 

using  the  Euler  equations  and  theorems  4.2  and  5.1.   The  solution  in  example 
6.7  "was  determined  by  inspection  and  checked  with  theorems  4.2  and  5.1. 
Examples  6.2,  6.6}    and  6.7  were  solved  before  the  usable  form  of  theorem  4.3 
was  determined^  unsuccessful  attempts  were  made  to  show  that  these  examples 
satisfied  theorem.  4.4  with  a  =  -1.   One  probably  will  not  be  able  to  solve 
problems  using  theorems  4.5  and  5.1  alone;  equivalent  problems  in  the  form  of 
problem  4.2  (possibly  requiring  a  bounded  state  va.ria.bles  constraint)  or  the 
calculus  of  variations  can  provide  a  great  deal  of  information. 

Remark  6.5.   Pontryagin,  Boltyanskii,  Gamkrelidze,  and  Mishchenko  [23,  chapter  VI] 
point  out  that  in  problems  with  bounded  state  variables  the  multiplier  func- 
tion generally  has  jumps.   These  occur  when  the  optimum  trajectory  enters 
or  leaves  the  boundary  and  when  the  optimum  trajectory  follows  the  boundary 
across  a  point  where  the  boundary  is  not  smooth.   Thus  we  expect  the  jumps  due 
to  the  end points  of  the  target  functions  in  the  examples  above,  and  the  jump 
due  to  the  corner  in  the  middle  of  the  target  function  in  example  6.5.   Since 
the  multiplier  satisfies  an  equation  similar  to  the  equation  for  Y(s,t),  we 
expect  the  jumps  to  be  propagated  once  they  appear.   The  extra  jump  in 
example  6.4  comes  from  the  trajectory  and  the  relationship  between  T  and  h. 
One  normally  expects   z  to  be  discontinuous  at  t  ;  if  the  equation  is  of 
neutral  type  this  discontinuity  is  propagated  forward  in  time.   If  T  is  not 
an  integral  multiple  of  h,  the  discontinuity  will  fall  in  the  interior  of 
[T-h, T];  if   £  is  smooth  at  that  point,  the  control  must  be  discontinuous  to 
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block  the  propagation  of  the  discontinuity  in  z#   Since  ^  determines  u, 
this  requires  a  corresponding  discontinuity  in  >|/. 


2 
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ui 


-Lt 


3 


EXAMPLE    6.2 


125 


UA 
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EXAMPLE     6.3 


X 
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J-t 


u 


J-t 


EXAMPLE     6.4 


127 


--J-t 


u„ 


-M 


EXAMPLE     6.5 
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EXAMPLE    6.6 


^t 
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